[ 529.858156] env[69499]: INFO neutron.common.config [-] Logging enabled! [ 529.858399] env[69499]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 26.0.0.0rc2.dev29 [ 529.858611] env[69499]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69499) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 529.858905] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 529.859016] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 529.859826] env[69499]: WARNING oslo_policy.policy [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 529.860065] env[69499]: WARNING oslo_policy.policy [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 529.861554] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] VMware NSXv3 Agent initialized successfully. [ 529.861918] env[69499]: DEBUG oslo_concurrency.lockutils [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] Acquiring lock "singleton_lock" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.862071] env[69499]: DEBUG oslo_concurrency.lockutils [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] Acquired lock "singleton_lock" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.862284] env[69499]: DEBUG oslo_concurrency.lockutils [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] Releasing lock "singleton_lock" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.862634] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] Full set of CONF: {{(pid=69499) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 529.862809] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ******************************************************************************** {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 529.862932] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] Configuration options gathered from: {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 529.863187] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 529.863361] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 529.863475] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ================================================================================ {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 529.863648] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] agent_down_time = 75 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.863795] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] allow_automatic_dhcp_failover = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.863938] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] allow_bulk = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.864101] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] api_extensions_path = {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.864249] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] api_paste_config = api-paste.ini {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.864396] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] auth_strategy = keystone {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.864508] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] backdoor_port = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.864642] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] backdoor_socket = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.864799] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] backlog = 4096 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.864948] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865125] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] bind_host = 0.0.0.0 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865278] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] bind_port = 9696 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865423] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] client_socket_timeout = 900 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865571] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] config_dir = [] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865688] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865833] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] config_source = [] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865977] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] control_exchange = neutron {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.866137] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] core_plugin = ml2 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.866283] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] debug = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.866426] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] default_availability_zones = [] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.866643] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.866838] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] dhcp_agent_notification = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.866995] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] dhcp_agents_per_network = 1 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.867155] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] dhcp_lease_duration = 86400 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.867306] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] dhcp_load_type = networks {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.867452] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] dns_domain = openstacklocal {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.867614] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.867774] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] enable_default_route_bfd = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.867918] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] enable_default_route_ecmp = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.868071] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] enable_dvr = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.868215] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] enable_new_agents = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.868354] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.868492] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] enable_signals = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.868629] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] enable_traditional_dhcp = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.868778] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] external_dns_driver = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.868973] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] filter_validation = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.869152] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] global_physnet_mtu = 8950 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.869300] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] graceful_shutdown_timeout = 60 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.869485] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] host = cpu-1 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.869634] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] host_dvr_for_dhcp = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.869803] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] http_retries = 3 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.869964] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] instance_format = [instance: %(uuid)s] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.870126] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.870274] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ipam_driver = internal {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.870415] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ipv6_pd_enabled = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.870554] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] l3_ha = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.870701] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.870848] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] l3_ha_network_physical_name = {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.870990] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] l3_ha_network_type = {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871152] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] log_color = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871298] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] log_config_append = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871441] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871583] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] log_dir = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871724] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] log_file = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871845] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] log_options = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871996] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] log_rotate_interval = 1 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.872163] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] log_rotate_interval_type = days {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.872311] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] log_rotation_type = none {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.872427] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.872561] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.872734] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.872884] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.873014] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.873171] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] max_dns_nameservers = 5 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.873317] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] max_header_line = 16384 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.873459] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] max_l3_agents_per_router = 3 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.873601] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] max_logfile_count = 30 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.873744] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] max_logfile_size_mb = 200 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.873884] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] max_subnet_host_routes = 20 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.874044] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] my_ip = 10.180.1.21 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.874193] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] my_ipv6 = ::1 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.874338] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] network_auto_schedule = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.874474] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] network_link_prefix = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.874647] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.874803] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] notify_nova_on_port_data_changes = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.874950] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] notify_nova_on_port_status_changes = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.875113] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] pagination_max_limit = -1 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.875258] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] publish_errors = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.875399] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] rate_limit_burst = 0 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.875548] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] rate_limit_except_level = CRITICAL {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.875727] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] rate_limit_interval = 0 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.875878] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] retry_until_window = 30 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.876036] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] router_distributed = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.876183] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] rpc_resources_processing_step = 20 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.876326] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] rpc_response_max_timeout = 600 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.876473] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] rpc_response_timeout = 60 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.876617] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] send_events_interval = 2 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.876775] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] service_plugins = ['router'] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.876924] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] setproctitle = on {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.877072] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] shell_completion = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.877221] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] state_path = /opt/stack/data/neutron {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.877366] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] syslog_log_facility = LOG_USER {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.877506] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] tcp_keepidle = 600 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.877650] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] transport_url = **** {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.877794] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] use_journal = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.877928] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] use_json = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.878078] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] use_ssl = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.878219] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] use_stderr = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.878362] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] use_syslog = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.878504] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] vlan_qinq = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.878669] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] vlan_transparent = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.878826] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] watch_log_file = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.878971] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] wsgi_default_pool_size = 100 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.879126] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] wsgi_keep_alive = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.879277] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.879420] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] wsgi_server_debug = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.879578] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_concurrency.disable_process_locking = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.879758] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.879913] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880071] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880224] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880374] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880518] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880675] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] profiler.connection_string = messaging:// {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880826] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] profiler.enabled = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880976] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] profiler.es_doc_type = notification {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.881136] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] profiler.es_scroll_size = 10000 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.881285] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] profiler.es_scroll_time = 2m {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.881429] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] profiler.filter_error_trace = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.881577] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] profiler.hmac_keys = **** {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.881755] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] profiler.sentinel_service_name = mymaster {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.881913] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] profiler.socket_timeout = 0.1 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.882070] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] profiler.trace_requests = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.882216] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] profiler.trace_sqlalchemy = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.882371] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] profiler_jaeger.process_tags = {} {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.882532] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] profiler_jaeger.service_name_prefix = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.882688] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] profiler_otlp.service_name_prefix = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.882851] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_policy.enforce_new_defaults = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.883136] env[69499]: WARNING oslo_config.cfg [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 529.883300] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_policy.enforce_scope = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.883456] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_policy.policy_default_rule = default {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.883613] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.883768] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.883919] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.884074] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.884217] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.884355] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.884497] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.884684] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.884857] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.885022] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] agent.extensions = [] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.885173] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.885321] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] service_providers.service_provider = [] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.885473] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] QUOTAS.default_quota = -1 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.885623] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.885768] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] QUOTAS.quota_floatingip = 50 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.885912] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] QUOTAS.quota_network = 100 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.886064] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] QUOTAS.quota_port = 500 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.886205] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.886418] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] QUOTAS.quota_router = 10 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.886592] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] QUOTAS.quota_security_group = 10 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.886741] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.886900] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] QUOTAS.quota_subnet = 100 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.887066] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] QUOTAS.track_quota_usage = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.887227] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.887369] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep.group = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.887507] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep.helper_command = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.887655] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.887800] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep.thread_pool_size = 8 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.887939] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep.user = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.888100] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.888247] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_dhcp_release.group = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.888505] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_dhcp_release.helper_command = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.888505] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.888655] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.888794] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_dhcp_release.user = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.888938] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.889088] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_ovs_vsctl.group = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.889229] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.889402] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.889555] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.889695] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_ovs_vsctl.user = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.889839] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_namespace.capabilities = [21] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.889976] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_namespace.group = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.890128] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_namespace.helper_command = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.890270] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.890417] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.890556] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_namespace.user = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.890703] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_conntrack.capabilities = [12] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.890844] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_conntrack.group = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.890980] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_conntrack.helper_command = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.891141] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.891285] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.891423] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_conntrack.user = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.891572] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_link.capabilities = [12, 21] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.891737] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_link.group = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.891884] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_link.helper_command = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.892041] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.892189] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_link.thread_pool_size = 8 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.892348] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] privsep_link.user = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.892519] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.892699] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.892808] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.continue_on_failed_promotions = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.893037] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.dscp = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.893103] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.dscp_inherit = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.893256] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.force_mp_to_policy = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.893396] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.locking_coordinator_url = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.893537] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.log_agent_heartbeats = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.893682] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.logging_expire = 1 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.893831] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.893975] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.894135] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.polling_interval = 240 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.894281] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.894428] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.894605] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.report_interval = 30.0 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.894756] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.894908] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.895069] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.895208] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.sync_skew = 60 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.895374] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.synchronization_queue_size = 20 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.895536] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT.use_helper_for_ns_read = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.895688] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] SECURITYGROUP.enable_ipset = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.895822] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] SECURITYGROUP.enable_security_group = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.895966] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.896129] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.896275] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] experimental.ipv6_pd_enabled = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.896438] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ml2.extension_drivers = ['port_security'] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.896581] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ml2.external_network_type = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.896735] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.896884] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ml2.overlay_ip_version = 4 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897041] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ml2.path_mtu = 8950 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897192] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ml2.physical_network_mtus = {} {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897343] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897492] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897641] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ml2.type_drivers = ['vlan'] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897792] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897935] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.898090] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.898245] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.898426] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.898600] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.898737] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.898885] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899043] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899244] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899423] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_login_password = **** {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899548] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899697] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_login_user = admin {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899844] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899995] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.900165] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.900293] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.900440] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.900591] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.900742] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.900889] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.901046] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.901198] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.901372] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.901535] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.901686] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.901890] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.902049] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.902249] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.902345] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.902512] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] nova.auth_section = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.902680] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] nova.auth_type = password {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.902836] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.902984] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] nova.certfile = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903137] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] nova.collect_timing = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903284] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] nova.endpoint_type = public {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903428] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] nova.insecure = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903566] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] nova.keyfile = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903717] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] nova.region_name = RegionOne {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903860] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] nova.split_loggers = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903999] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] nova.timeout = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.904158] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] placement.auth_section = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.904307] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] placement.auth_type = password {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.904482] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.904649] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] placement.certfile = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.904801] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] placement.collect_timing = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.904959] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] placement.endpoint_type = public {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.905111] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] placement.insecure = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.905250] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] placement.keyfile = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.905387] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] placement.region_name = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.905540] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] placement.split_loggers = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.905664] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] placement.timeout = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.905810] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.auth_section = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.905951] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.auth_type = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.906095] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.cafile = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.906233] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.certfile = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.906373] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.collect_timing = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.906511] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.connect_retries = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.906649] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.connect_retry_delay = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.906790] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.enable_notifications = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.906926] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.endpoint_override = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.907077] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.insecure = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.907218] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.interface = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.907356] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.keyfile = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.907516] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.max_version = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.907658] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.min_version = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.907798] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.region_name = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.907935] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.retriable_status_codes = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.908086] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.service_name = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.908225] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.service_type = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.908408] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.split_loggers = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.908503] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.status_code_retries = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.908639] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.status_code_retry_delay = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.908778] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.timeout = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.908915] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.valid_interfaces = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.909064] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ironic.version = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.909243] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] cli_script.dry_run = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.909359] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.909501] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.909643] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.909785] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.909922] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.910074] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.910215] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.910379] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.910541] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.910702] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.910837] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.910984] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.911145] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.911288] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.911431] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.911579] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.911722] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.911864] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.912017] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.912162] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.912303] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.912451] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.912631] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.912785] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.912931] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.913096] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.913247] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.913415] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.913572] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.913723] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.913865] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.ssl = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.914024] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.914642] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.914642] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.914642] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.914642] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.914887] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.914968] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_notifications.driver = [] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.915149] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_notifications.retry = -1 {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.915310] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.915453] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.915575] env[69499]: DEBUG oslo_service.backend.eventlet.service [None req-a6337267-6262-4eab-bdcc-c50f0a325531 None None] ******************************************************************************** {{(pid=69499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 529.916613] env[69499]: DEBUG neutron.agent.securitygroups_rpc [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Init firewall settings (driver=nsxv3) {{(pid=69499) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 529.917900] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69499) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 529.918163] env[69499]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] RPC agent_id: nsxm-l-01a.corp.local [ 529.920450] env[69499]: DEBUG dogpile.cache.region [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 529.920581] env[69499]: DEBUG dogpile.lock [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 529.920673] env[69499]: DEBUG dogpile.lock [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 529.920784] env[69499]: DEBUG dogpile.lock [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 529.920844] env[69499]: DEBUG dogpile.cache.region [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 529.920975] env[69499]: DEBUG dogpile.lock [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 529.921181] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 529.963766] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Session token - acquiring [ 529.965348] env[69499]: DEBUG networking_nsxv3.common.locking [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.965596] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.965596] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.966057] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 529.976393] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.243263] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 530.264518] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 530.264717] env[69499]: DEBUG dogpile.cache.region [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Cache value generated in 0.344 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 530.264844] env[69499]: DEBUG dogpile.lock [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 530.264968] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Activating Policy API Provider. [ 530.265185] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Looking for the default Infrastructure Rules. [ 530.327617] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Looking for the Default Layer3 Logged Drop Section. [ 530.339859] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 530.340322] env[69499]: DEBUG networking_nsxv3.common.locking [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.340508] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquiring lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.340639] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.340933] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired external semaphore "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.341279] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 530.857549] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 531.359893] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 531.862716] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Inventory metadata is going to be refreshed. [ 531.862897] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 532.562359] env[69499]: DEBUG networking_nsxv3.common.locking [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.562885] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.562885] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.563072] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.575436] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 532.678781] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.679902] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 532.698161] env[69499]: DEBUG networking_nsxv3.common.locking [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.698420] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.698502] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.698737] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.698861] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.699024] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 532.699145] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.699255] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 532.717283] env[69499]: DEBUG networking_nsxv3.common.locking [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.717579] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.717579] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.717846] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.718028] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.718182] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 532.736308] env[69499]: DEBUG networking_nsxv3.common.locking [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.736554] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.736597] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.736846] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.736983] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.737144] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 532.753781] env[69499]: DEBUG networking_nsxv3.common.locking [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.753979] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquiring lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.754067] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.754349] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired external semaphore "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.754488] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Releasing lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.754664] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 532.754776] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.754890] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 532.773259] env[69499]: DEBUG networking_nsxv3.common.locking [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.773441] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquiring lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.773541] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.773810] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired external semaphore "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.773964] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Releasing lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.774120] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 532.774229] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.774336] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 532.791800] env[69499]: DEBUG networking_nsxv3.common.locking [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.791993] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.792120] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.792321] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.792464] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.792625] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 532.792733] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.792837] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Inventory metadata have been refreshed. [ 532.792936] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Dryrun:True. Metadata refresh completed. [ 532.793065] env[69499]: DEBUG oslo_concurrency.lockutils [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Releasing lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.794850] env[69499]: INFO neutron.agent.agent_extensions_manager [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Loaded agent extensions: [] [ 532.795555] env[69499]: DEBUG neutron_lib.callbacks.manager [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69499) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 532.848124] env[69499]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] NSXv3 Agent Agent RPC Daemon Started! [ 532.848241] env[69499]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] NSXv3 Agent Agent loop - iteration:0 started [ 532.848350] env[69499]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] NSXv3 Agent Agent out of sync with plugin! [ 537.796183] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 537.796551] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.798062] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 542.798407] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 546.706243] env[69499]: INFO networking_nsxv3.common.synchronization [None req-cff17fc7-f351-4477-be35-9d44475a1a26 demo admin] Enqueued Resource ID: d99da536-bdb7-44de-93cc-dc6226b2e3cb with Priority: HIGHEST for action security_group_rules [ 546.706478] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d99da536-bdb7-44de-93cc-dc6226b2e3cb with Priority: HIGHEST for action security_group_rules [ 546.706703] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d99da536-bdb7-44de-93cc-dc6226b2e3cb taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.706837] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d99da536-bdb7-44de-93cc-dc6226b2e3cb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.706906] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d99da536-bdb7-44de-93cc-dc6226b2e3cb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.707377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d99da536-bdb7-44de-93cc-dc6226b2e3cb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.707466] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d99da536-bdb7-44de-93cc-dc6226b2e3cb',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.227262] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.227496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.227496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.227685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.227741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.227843] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d99da536-bdb7-44de-93cc-dc6226b2e3cb already deleted. [ 547.227942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d99da536-bdb7-44de-93cc-dc6226b2e3cb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.707423] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 551.707884] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 556.708358] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 556.708694] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 561.709992] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 561.710335] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 566.711809] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 566.712150] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.213276] env[69499]: INFO networking_nsxv3.common.synchronization [None req-e1388175-04aa-427e-9873-72678cf4662b None None] Enqueued Resource ID: e0875f4b-b559-49cf-bf94-bc88188bc615 with Priority: HIGHEST for action port [ 571.214215] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0875f4b-b559-49cf-bf94-bc88188bc615 with Priority: HIGHEST for action port [ 571.214215] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0875f4b-b559-49cf-bf94-bc88188bc615 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.214394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0875f4b-b559-49cf-bf94-bc88188bc615" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.214394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0875f4b-b559-49cf-bf94-bc88188bc615" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.214582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0875f4b-b559-49cf-bf94-bc88188bc615" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.214650] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0875f4b-b559-49cf-bf94-bc88188bc615',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.718377] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0875f4b-b559-49cf-bf94-bc88188bc615 [ 571.718377] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.718377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.718377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.718377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.718377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.718377] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0875f4b-b559-49cf-bf94-bc88188bc615 already deleted. [ 571.718377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0875f4b-b559-49cf-bf94-bc88188bc615" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.084339] env[69499]: INFO networking_nsxv3.common.synchronization [None req-6afcc1ac-ac9f-4367-865b-bda3cf104e6f None None] Enqueued Resource ID: d0b5bf44-0cff-4949-b4f2-31f3453443c9 with Priority: HIGHEST for action port [ 573.084686] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b5bf44-0cff-4949-b4f2-31f3453443c9 with Priority: HIGHEST for action port [ 573.085133] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0b5bf44-0cff-4949-b4f2-31f3453443c9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.085304] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0b5bf44-0cff-4949-b4f2-31f3453443c9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.085353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0b5bf44-0cff-4949-b4f2-31f3453443c9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.085590] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0b5bf44-0cff-4949-b4f2-31f3453443c9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.085689] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0b5bf44-0cff-4949-b4f2-31f3453443c9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.588407] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0b5bf44-0cff-4949-b4f2-31f3453443c9 [ 573.588678] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.588819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.588894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.589134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.589244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.589518] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0b5bf44-0cff-4949-b4f2-31f3453443c9 already deleted. [ 573.589752] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0b5bf44-0cff-4949-b4f2-31f3453443c9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.798301] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.799431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.799431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.799537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.799786] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.302164] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.805811] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.308643] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 575.309045] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 575.852033] env[69499]: INFO networking_nsxv3.common.synchronization [None req-3c08066f-ca85-4f95-bce8-291572395af3 None None] Enqueued Resource ID: 0b4abe90-2e73-4349-b6f2-7b3e04299bcb with Priority: HIGHEST for action port [ 575.852322] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b4abe90-2e73-4349-b6f2-7b3e04299bcb with Priority: HIGHEST for action port [ 575.852992] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b4abe90-2e73-4349-b6f2-7b3e04299bcb taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.853139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b4abe90-2e73-4349-b6f2-7b3e04299bcb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.853181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b4abe90-2e73-4349-b6f2-7b3e04299bcb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.853498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b4abe90-2e73-4349-b6f2-7b3e04299bcb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.853498] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b4abe90-2e73-4349-b6f2-7b3e04299bcb',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.043347] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.043496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.043576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.043786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.059850] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 576.060958] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.061844] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 576.081149] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.081149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.081149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.081149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.081149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.081149] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 576.081149] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.081149] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 576.097935] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.098279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.098453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.098744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.098994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.099203] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 576.119131] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.119131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.119131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.119131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.119131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.119131] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 576.138026] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.138026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.138026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.138026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.138026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.138026] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 576.138026] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.138026] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 576.154202] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.154812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.155040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.155340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.155524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.155719] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 576.155868] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.156034] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 576.175021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.175021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.175021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.175021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.175021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.175021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 576.175021] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.175021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 576.175021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 576.175021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 576.175021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 576.175021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 576.175021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 576.175021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 576.175021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 576.197254] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.197254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.197254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.197254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.197254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.197254] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 576.212746] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.212746] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.212746] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.212746] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.213612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.224918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.355516] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b4abe90-2e73-4349-b6f2-7b3e04299bcb [ 576.355750] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.355808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.355868] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.356175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.356232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.356342] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b4abe90-2e73-4349-b6f2-7b3e04299bcb already deleted. [ 576.356448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b4abe90-2e73-4349-b6f2-7b3e04299bcb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.817623] env[69499]: INFO networking_nsxv3.common.synchronization [None req-e8a185b9-d881-43fc-b469-78191f522b3e None None] Enqueued Resource ID: b3d9c6cb-ddda-4f8d-83a2-2849e144a8eb with Priority: HIGHEST for action port [ 576.817623] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3d9c6cb-ddda-4f8d-83a2-2849e144a8eb with Priority: HIGHEST for action port [ 576.817623] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3d9c6cb-ddda-4f8d-83a2-2849e144a8eb taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.817623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3d9c6cb-ddda-4f8d-83a2-2849e144a8eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.817623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3d9c6cb-ddda-4f8d-83a2-2849e144a8eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.819347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3d9c6cb-ddda-4f8d-83a2-2849e144a8eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.819578] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3d9c6cb-ddda-4f8d-83a2-2849e144a8eb',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.322734] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3d9c6cb-ddda-4f8d-83a2-2849e144a8eb [ 577.322734] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.322734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.322734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.322734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.322734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.322734] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3d9c6cb-ddda-4f8d-83a2-2849e144a8eb already deleted. [ 577.322734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3d9c6cb-ddda-4f8d-83a2-2849e144a8eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.744582] env[69499]: INFO networking_nsxv3.common.synchronization [None req-1ad19cc6-5534-43dd-a776-94c7bc22c632 None None] Enqueued Resource ID: 2ab46267-1791-4645-a3bb-41c219aaa71c with Priority: HIGHEST for action port [ 577.744848] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ab46267-1791-4645-a3bb-41c219aaa71c with Priority: HIGHEST for action port [ 577.745500] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ab46267-1791-4645-a3bb-41c219aaa71c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.745688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ab46267-1791-4645-a3bb-41c219aaa71c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.745688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ab46267-1791-4645-a3bb-41c219aaa71c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.745977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ab46267-1791-4645-a3bb-41c219aaa71c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.746232] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ab46267-1791-4645-a3bb-41c219aaa71c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.226402] env[69499]: INFO networking_nsxv3.common.synchronization [None req-19c9ba4e-2d61-4089-ac94-c6120f7da68a None None] Enqueued Resource ID: 358718f9-182d-441a-a493-7ccb1452b5f1 with Priority: HIGHEST for action port [ 578.226402] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 358718f9-182d-441a-a493-7ccb1452b5f1 with Priority: HIGHEST for action port [ 578.226783] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-358718f9-182d-441a-a493-7ccb1452b5f1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.226905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-358718f9-182d-441a-a493-7ccb1452b5f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.226970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-358718f9-182d-441a-a493-7ccb1452b5f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.227268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-358718f9-182d-441a-a493-7ccb1452b5f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.227345] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('358718f9-182d-441a-a493-7ccb1452b5f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.250070] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ab46267-1791-4645-a3bb-41c219aaa71c [ 578.250345] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.251018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.251018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.251018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.251206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.251206] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ab46267-1791-4645-a3bb-41c219aaa71c already deleted. [ 578.251319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ab46267-1791-4645-a3bb-41c219aaa71c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.550750] env[69499]: INFO networking_nsxv3.common.synchronization [None req-a2423fed-a104-44bb-925b-70414a1b41a2 None None] Enqueued Resource ID: 7f4af109-cc5e-48c5-bc9b-82988dcb2c8c with Priority: HIGHEST for action port [ 578.550750] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4af109-cc5e-48c5-bc9b-82988dcb2c8c with Priority: HIGHEST for action port [ 578.550750] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f4af109-cc5e-48c5-bc9b-82988dcb2c8c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.550750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f4af109-cc5e-48c5-bc9b-82988dcb2c8c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.550750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f4af109-cc5e-48c5-bc9b-82988dcb2c8c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.550750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f4af109-cc5e-48c5-bc9b-82988dcb2c8c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.550985] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f4af109-cc5e-48c5-bc9b-82988dcb2c8c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.729547] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 358718f9-182d-441a-a493-7ccb1452b5f1 [ 578.729649] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.729773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.729843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.730780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.730780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.730780] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:358718f9-182d-441a-a493-7ccb1452b5f1 already deleted. [ 578.730780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-358718f9-182d-441a-a493-7ccb1452b5f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.055029] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f4af109-cc5e-48c5-bc9b-82988dcb2c8c [ 579.055501] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.055501] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.055501] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.055640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.055640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.056312] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f4af109-cc5e-48c5-bc9b-82988dcb2c8c already deleted. [ 579.056312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f4af109-cc5e-48c5-bc9b-82988dcb2c8c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.764980] env[69499]: INFO networking_nsxv3.common.synchronization [None req-dc6e8d35-ef57-458e-810f-396093ecba3e None None] Enqueued Resource ID: 75766644-3815-466e-bbdf-94e0f98d6c91 with Priority: HIGHEST for action port [ 579.765266] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75766644-3815-466e-bbdf-94e0f98d6c91 with Priority: HIGHEST for action port [ 579.765840] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-75766644-3815-466e-bbdf-94e0f98d6c91 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.765966] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75766644-3815-466e-bbdf-94e0f98d6c91" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.766046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75766644-3815-466e-bbdf-94e0f98d6c91" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.766305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75766644-3815-466e-bbdf-94e0f98d6c91" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.766378] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75766644-3815-466e-bbdf-94e0f98d6c91',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.091195] env[69499]: INFO networking_nsxv3.common.synchronization [None req-3effd85e-69e3-4dca-8aa0-2dcd5315a849 None None] Enqueued Resource ID: e7f3122f-3cca-46c9-8642-44714c2db242 with Priority: HIGHEST for action port [ 580.091467] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7f3122f-3cca-46c9-8642-44714c2db242 with Priority: HIGHEST for action port [ 580.092011] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7f3122f-3cca-46c9-8642-44714c2db242 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.092114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7f3122f-3cca-46c9-8642-44714c2db242" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.092114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7f3122f-3cca-46c9-8642-44714c2db242" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.092381] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7f3122f-3cca-46c9-8642-44714c2db242" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.092471] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7f3122f-3cca-46c9-8642-44714c2db242',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.196312] env[69499]: INFO networking_nsxv3.common.synchronization [None req-352d7619-fdae-4ac0-a070-830936566478 None None] Enqueued Resource ID: 72d5cf21-9841-4059-b8ec-40e7f8bf69b4 with Priority: HIGHEST for action port [ 580.196690] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72d5cf21-9841-4059-b8ec-40e7f8bf69b4 with Priority: HIGHEST for action port [ 580.197375] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-72d5cf21-9841-4059-b8ec-40e7f8bf69b4 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.197375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72d5cf21-9841-4059-b8ec-40e7f8bf69b4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.197375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72d5cf21-9841-4059-b8ec-40e7f8bf69b4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.197778] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72d5cf21-9841-4059-b8ec-40e7f8bf69b4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.197778] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72d5cf21-9841-4059-b8ec-40e7f8bf69b4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.271134] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75766644-3815-466e-bbdf-94e0f98d6c91 [ 580.272450] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.272450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.272450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.272450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.272450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.272450] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75766644-3815-466e-bbdf-94e0f98d6c91 already deleted. [ 580.272450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75766644-3815-466e-bbdf-94e0f98d6c91" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.596808] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7f3122f-3cca-46c9-8642-44714c2db242 [ 580.596808] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.596808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.596808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.596808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.596808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.596808] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7f3122f-3cca-46c9-8642-44714c2db242 already deleted. [ 580.596808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7f3122f-3cca-46c9-8642-44714c2db242" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.699757] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72d5cf21-9841-4059-b8ec-40e7f8bf69b4 [ 580.700077] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.700238] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.700318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.700530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.700637] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.700753] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72d5cf21-9841-4059-b8ec-40e7f8bf69b4 already deleted. [ 580.700831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72d5cf21-9841-4059-b8ec-40e7f8bf69b4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.822886] env[69499]: INFO networking_nsxv3.common.synchronization [None req-e55f9db0-7aab-405b-b41a-8bcbb586f204 None None] Enqueued Resource ID: 79258167-fd5e-463f-b011-3608e55673ed with Priority: HIGHEST for action port [ 580.823695] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79258167-fd5e-463f-b011-3608e55673ed with Priority: HIGHEST for action port [ 580.824324] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-79258167-fd5e-463f-b011-3608e55673ed taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.825017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79258167-fd5e-463f-b011-3608e55673ed" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.825017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79258167-fd5e-463f-b011-3608e55673ed" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.825017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79258167-fd5e-463f-b011-3608e55673ed" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.825017] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79258167-fd5e-463f-b011-3608e55673ed',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.156978] env[69499]: INFO networking_nsxv3.common.synchronization [None req-fc539380-48f9-4f42-9061-2b81ee7074d0 None None] Enqueued Resource ID: b6f4840e-a5f9-4565-ab2b-9f65d113b989 with Priority: HIGHEST for action port [ 581.157487] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6f4840e-a5f9-4565-ab2b-9f65d113b989 with Priority: HIGHEST for action port [ 581.157874] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6f4840e-a5f9-4565-ab2b-9f65d113b989 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.157874] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6f4840e-a5f9-4565-ab2b-9f65d113b989" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.157983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6f4840e-a5f9-4565-ab2b-9f65d113b989" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.160730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6f4840e-a5f9-4565-ab2b-9f65d113b989" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.160730] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6f4840e-a5f9-4565-ab2b-9f65d113b989',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.326790] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79258167-fd5e-463f-b011-3608e55673ed [ 581.327088] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.327265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.327575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.328748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.328834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.329089] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79258167-fd5e-463f-b011-3608e55673ed already deleted. [ 581.329089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79258167-fd5e-463f-b011-3608e55673ed" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.662403] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6f4840e-a5f9-4565-ab2b-9f65d113b989 [ 581.662729] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.662868] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.662936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.663158] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.663245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.663342] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6f4840e-a5f9-4565-ab2b-9f65d113b989 already deleted. [ 581.663420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6f4840e-a5f9-4565-ab2b-9f65d113b989" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.393535] env[69499]: INFO networking_nsxv3.common.synchronization [None req-f490cdf4-a1ec-4d4c-b686-4730d9fbff46 None None] Enqueued Resource ID: 55bf0aa7-3d6a-4a8d-80a7-55ac146e7e69 with Priority: HIGHEST for action port [ 584.393779] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55bf0aa7-3d6a-4a8d-80a7-55ac146e7e69 with Priority: HIGHEST for action port [ 584.394397] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-55bf0aa7-3d6a-4a8d-80a7-55ac146e7e69 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.394476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55bf0aa7-3d6a-4a8d-80a7-55ac146e7e69" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.394541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55bf0aa7-3d6a-4a8d-80a7-55ac146e7e69" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.394787] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55bf0aa7-3d6a-4a8d-80a7-55ac146e7e69" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.394868] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55bf0aa7-3d6a-4a8d-80a7-55ac146e7e69',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.453597] env[69499]: INFO networking_nsxv3.common.synchronization [None req-75d4c7ea-7ba3-45c6-ae19-a07758d50eb1 None None] Enqueued Resource ID: b0da7cc8-22e1-4ae5-8c56-e8d06d4bc524 with Priority: HIGHEST for action port [ 584.453597] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0da7cc8-22e1-4ae5-8c56-e8d06d4bc524 with Priority: HIGHEST for action port [ 584.453597] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0da7cc8-22e1-4ae5-8c56-e8d06d4bc524 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.453945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0da7cc8-22e1-4ae5-8c56-e8d06d4bc524" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.454126] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0da7cc8-22e1-4ae5-8c56-e8d06d4bc524" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.454456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0da7cc8-22e1-4ae5-8c56-e8d06d4bc524" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.454643] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0da7cc8-22e1-4ae5-8c56-e8d06d4bc524',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.541487] env[69499]: INFO networking_nsxv3.common.synchronization [req-f7eef2e9-fafc-4a77-86f4-0e425d559156 req-13101cb8-b06b-46cf-8035-3426babd6247 tempest-SecurityGroupRulesNegativeTestJSON-475364943 tempest-SecurityGroupRulesNegativeTestJSON-475364943-project-member] Enqueued Resource ID: 275fd253-6177-4024-93b6-658f76f8f3a1 with Priority: HIGHEST for action security_group_rules [ 584.542781] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 275fd253-6177-4024-93b6-658f76f8f3a1 with Priority: HIGHEST for action security_group_rules [ 584.542781] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-275fd253-6177-4024-93b6-658f76f8f3a1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.542781] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-275fd253-6177-4024-93b6-658f76f8f3a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.542781] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-275fd253-6177-4024-93b6-658f76f8f3a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.544812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-275fd253-6177-4024-93b6-658f76f8f3a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.545740] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('275fd253-6177-4024-93b6-658f76f8f3a1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.710467] env[69499]: INFO networking_nsxv3.common.synchronization [None req-95f7b25d-a882-4a84-a4c3-00aaefb4e1f6 None None] Enqueued Resource ID: 53fb38cf-3f95-489e-8832-46f9060460db with Priority: HIGHEST for action port [ 584.711124] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53fb38cf-3f95-489e-8832-46f9060460db with Priority: HIGHEST for action port [ 584.711931] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-53fb38cf-3f95-489e-8832-46f9060460db taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.711931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53fb38cf-3f95-489e-8832-46f9060460db" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.711931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53fb38cf-3f95-489e-8832-46f9060460db" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.711931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53fb38cf-3f95-489e-8832-46f9060460db" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.712306] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53fb38cf-3f95-489e-8832-46f9060460db',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.877528] env[69499]: INFO networking_nsxv3.common.synchronization [None req-10ec0b95-b6d5-451e-8fa4-13a4bb6b056b None None] Enqueued Resource ID: f3ca960b-b297-498f-8250-83503e499c04 with Priority: HIGHEST for action port [ 584.878457] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ca960b-b297-498f-8250-83503e499c04 with Priority: HIGHEST for action port [ 584.878774] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3ca960b-b297-498f-8250-83503e499c04 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.878943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3ca960b-b297-498f-8250-83503e499c04" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.879031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3ca960b-b297-498f-8250-83503e499c04" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.879656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3ca960b-b297-498f-8250-83503e499c04" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.879737] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3ca960b-b297-498f-8250-83503e499c04',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.897646] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55bf0aa7-3d6a-4a8d-80a7-55ac146e7e69 [ 584.897774] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.897930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.897998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.898229] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.898743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.898839] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55bf0aa7-3d6a-4a8d-80a7-55ac146e7e69 already deleted. [ 584.898919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55bf0aa7-3d6a-4a8d-80a7-55ac146e7e69" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.960736] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0da7cc8-22e1-4ae5-8c56-e8d06d4bc524 [ 584.960736] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.960914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.961031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.961277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.965523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.965523] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0da7cc8-22e1-4ae5-8c56-e8d06d4bc524 already deleted. [ 584.965523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0da7cc8-22e1-4ae5-8c56-e8d06d4bc524" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.068350] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.068350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.068350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.068350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.068350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.068350] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 275fd253-6177-4024-93b6-658f76f8f3a1 already deleted. [ 585.068350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-275fd253-6177-4024-93b6-658f76f8f3a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.216387] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53fb38cf-3f95-489e-8832-46f9060460db [ 585.217253] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.217253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.217253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.217253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.217253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.217253] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53fb38cf-3f95-489e-8832-46f9060460db already deleted. [ 585.217569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53fb38cf-3f95-489e-8832-46f9060460db" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.383296] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3ca960b-b297-498f-8250-83503e499c04 [ 585.383585] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.383756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.383905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.384120] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.384250] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.384372] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3ca960b-b297-498f-8250-83503e499c04 already deleted. [ 585.384498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3ca960b-b297-498f-8250-83503e499c04" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.669531] env[69499]: INFO networking_nsxv3.common.synchronization [req-b583221c-b7f9-4dfd-bccb-2455faefbb81 req-371ecd79-72e9-4ad4-8f9f-bc01dd04ff87 tempest-SecurityGroupRulesNegativeTestJSON-475364943 tempest-SecurityGroupRulesNegativeTestJSON-475364943-project-member] Enqueued Resource ID: 275fd253-6177-4024-93b6-658f76f8f3a1 with Priority: HIGHEST for action security_group_rules [ 586.670103] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 275fd253-6177-4024-93b6-658f76f8f3a1 with Priority: HIGHEST for action security_group_rules [ 586.670454] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-275fd253-6177-4024-93b6-658f76f8f3a1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.670606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-275fd253-6177-4024-93b6-658f76f8f3a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.670678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-275fd253-6177-4024-93b6-658f76f8f3a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.674020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-275fd253-6177-4024-93b6-658f76f8f3a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.674020] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('275fd253-6177-4024-93b6-658f76f8f3a1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.195750] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.195750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.195750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.196723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.197163] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.198366] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 275fd253-6177-4024-93b6-658f76f8f3a1 already deleted. [ 587.198784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-275fd253-6177-4024-93b6-658f76f8f3a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.661241] env[69499]: INFO networking_nsxv3.common.synchronization [None req-380d0d6d-1783-4820-bef0-7817e35152c3 tempest-VolumesAssistedSnapshotsTest-628391310 tempest-VolumesAssistedSnapshotsTest-628391310-project-member] Enqueued Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGHEST for action security_group_rules [ 587.661953] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGHEST for action security_group_rules [ 587.662070] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-032cabed-a789-4100-95a3-6e4998fdb5cc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.662196] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.662258] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.662498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.662603] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('032cabed-a789-4100-95a3-6e4998fdb5cc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.997869] env[69499]: INFO networking_nsxv3.common.synchronization [None req-ea4add72-b3f8-4a4e-a2e9-02460e29fe4c tempest-VolumesAssistedSnapshotsTest-628391310 tempest-VolumesAssistedSnapshotsTest-628391310-project-member] Enqueued Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGHEST for action security_group_rules [ 587.998849] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGHEST for action security_group_rules [ 587.999721] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-032cabed-a789-4100-95a3-6e4998fdb5cc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.999721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.186785] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.186785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.186785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.186785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.186785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.186785] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 032cabed-a789-4100-95a3-6e4998fdb5cc already deleted. [ 588.186785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.187329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.187329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.187329] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('032cabed-a789-4100-95a3-6e4998fdb5cc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.307039] env[69499]: INFO networking_nsxv3.common.synchronization [req-af6329f3-4db0-44ac-a29e-5bd3e36f849c req-ef0c9394-2a00-42e6-aa27-217705fd69ce tempest-ImagesNegativeTestJSON-1129831825 tempest-ImagesNegativeTestJSON-1129831825-project-member] Enqueued Resource ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc with Priority: HIGHEST for action security_group_members [ 588.307591] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc with Priority: HIGHEST for action security_group_members [ 588.307880] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.307999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.308078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.308343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.308486] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.308587] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.308649] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.308803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.308876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.308965] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.709979] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.710167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.710253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.710470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.710560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.710861] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 032cabed-a789-4100-95a3-6e4998fdb5cc already deleted. [ 588.710861] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.817741] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.817741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.817741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.817741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.817741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.817741] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.817741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.817741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.817741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.817741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.817741] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc already deleted. [ 588.817741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.936599] env[69499]: INFO networking_nsxv3.common.synchronization [None req-32638f97-e90d-47e0-bc33-6af224d64e6a None None] Enqueued Resource ID: 85a8f712-280d-4450-a9b3-c5e5d68492e2 with Priority: HIGHEST for action port [ 588.936938] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85a8f712-280d-4450-a9b3-c5e5d68492e2 with Priority: HIGHEST for action port [ 588.937364] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-85a8f712-280d-4450-a9b3-c5e5d68492e2 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.937517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85a8f712-280d-4450-a9b3-c5e5d68492e2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.937588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85a8f712-280d-4450-a9b3-c5e5d68492e2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.937865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85a8f712-280d-4450-a9b3-c5e5d68492e2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.937967] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85a8f712-280d-4450-a9b3-c5e5d68492e2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.101317] env[69499]: INFO networking_nsxv3.common.synchronization [None req-e70e9857-2bbb-4c04-a89c-699007981a79 None None] Enqueued Resource ID: 3b182163-eaa8-4e10-8dd4-409bc9587fb9 with Priority: HIGHEST for action port [ 589.101562] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b182163-eaa8-4e10-8dd4-409bc9587fb9 with Priority: HIGHEST for action port [ 589.102100] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b182163-eaa8-4e10-8dd4-409bc9587fb9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.102233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b182163-eaa8-4e10-8dd4-409bc9587fb9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.102303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b182163-eaa8-4e10-8dd4-409bc9587fb9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.102659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b182163-eaa8-4e10-8dd4-409bc9587fb9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.102659] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b182163-eaa8-4e10-8dd4-409bc9587fb9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.439783] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85a8f712-280d-4450-a9b3-c5e5d68492e2 [ 589.440114] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.440252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.440252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.440443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.440596] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.440877] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85a8f712-280d-4450-a9b3-c5e5d68492e2 already deleted. [ 589.440877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85a8f712-280d-4450-a9b3-c5e5d68492e2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.605322] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b182163-eaa8-4e10-8dd4-409bc9587fb9 [ 589.605384] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.605573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.605624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.605844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.605936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.606046] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b182163-eaa8-4e10-8dd4-409bc9587fb9 already deleted. [ 589.606132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b182163-eaa8-4e10-8dd4-409bc9587fb9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.921940] env[69499]: INFO networking_nsxv3.common.synchronization [req-d5f13856-53c6-41fd-afd8-8381652375df req-cc84bde9-c6c3-4ad3-aa4b-26f1af4fc2c7 tempest-DeleteServersAdminTestJSON-760663801 tempest-DeleteServersAdminTestJSON-760663801-project-member] Enqueued Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_members [ 589.922575] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_members [ 589.922575] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.922715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.922751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.923012] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.923573] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.923831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.924112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.924307] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.924564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.924670] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.394900] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.395195] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-234" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.395231] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-234" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.395565] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-234" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.397936] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.397936] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.397936] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.397936] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.397936] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.397936] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 590.397936] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 590.397936] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 590.397936] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 590.397936] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 590.398316] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 590.398316] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 590.419179] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 590.419701] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 590.419701] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 590.419701] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-234" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.422407] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-5f3fd6d5-547b-4244-9906-52d6ce2478c4 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.422603] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-5f3fd6d5-547b-4244-9906-52d6ce2478c4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.422730] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-5f3fd6d5-547b-4244-9906-52d6ce2478c4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.423368] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-5f3fd6d5-547b-4244-9906-52d6ce2478c4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.423368] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f3fd6d5-547b-4244-9906-52d6ce2478c4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.429656] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.429656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.429656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.429656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.429656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.429656] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.429656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.429656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.429656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.429656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.429656] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 already deleted. [ 590.429656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.530888] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.531268] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.531268] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.532047] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.532047] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.532187] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.532283] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.532971] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.532971] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.533090] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 590.533165] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 590.533281] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 590.533393] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 590.533509] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 590.533683] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 590.534033] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 590.537300] env[69499]: INFO networking_nsxv3.common.synchronization [None req-bbf82346-3c4e-42f1-bab3-413e3d536267 None None] Enqueued Resource ID: 8233d5a7-ab26-4b56-be31-cd5d4db15bb0 with Priority: HIGHEST for action port [ 590.538191] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8233d5a7-ab26-4b56-be31-cd5d4db15bb0 with Priority: HIGHEST for action port [ 590.538433] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-8233d5a7-ab26-4b56-be31-cd5d4db15bb0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.538544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8233d5a7-ab26-4b56-be31-cd5d4db15bb0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.538619] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8233d5a7-ab26-4b56-be31-cd5d4db15bb0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.538857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8233d5a7-ab26-4b56-be31-cd5d4db15bb0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.538941] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8233d5a7-ab26-4b56-be31-cd5d4db15bb0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.551896] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 590.551968] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 590.552933] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 590.552933] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.552933] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-96b723bd-3da4-4330-8ae1-f6fb37a8300b taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.552933] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-96b723bd-3da4-4330-8ae1-f6fb37a8300b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.552933] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-96b723bd-3da4-4330-8ae1-f6fb37a8300b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.553195] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-96b723bd-3da4-4330-8ae1-f6fb37a8300b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.553589] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96b723bd-3da4-4330-8ae1-f6fb37a8300b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.927425] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.927706] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.927873] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.928201] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.928358] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.928515] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 5f3fd6d5-547b-4244-9906-52d6ce2478c4 not found, creating... [ 590.928783] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.929091] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.929091] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.929299] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.929411] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.929808] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.930660] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.930660] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.930959] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.931125] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.931291] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 5f3fd6d5-547b-4244-9906-52d6ce2478c4 is going to be created. [ 590.950775] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.951827] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.951827] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.952808] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.953229] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.953599] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-5f3fd6d5-547b-4244-9906-52d6ce2478c4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.042428] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8233d5a7-ab26-4b56-be31-cd5d4db15bb0 [ 591.043275] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.043547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.043686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.044016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.044176] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.044329] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8233d5a7-ab26-4b56-be31-cd5d4db15bb0 already deleted. [ 591.045028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8233d5a7-ab26-4b56-be31-cd5d4db15bb0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.057040] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.057452] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.059822] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.059822] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.059822] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.059822] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 96b723bd-3da4-4330-8ae1-f6fb37a8300b not found, creating... [ 591.059822] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.059822] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.060099] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.060287] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.060531] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.061033] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.062440] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.062440] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.062440] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.062440] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.062556] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 96b723bd-3da4-4330-8ae1-f6fb37a8300b is going to be created. [ 591.084457] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.087554] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.087554] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.087554] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.087554] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.087554] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-96b723bd-3da4-4330-8ae1-f6fb37a8300b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.859174] env[69499]: INFO networking_nsxv3.common.synchronization [None req-0bc0a494-de9b-4f10-bfe3-b499165625b4 tempest-ServersWithSpecificFlavorTestJSON-328556625 tempest-ServersWithSpecificFlavorTestJSON-328556625-project-member] Enqueued Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_rules [ 591.860276] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_rules [ 591.860629] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8579ac1e-c68a-42fa-957e-e205942d2fbc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.860754] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.860820] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.861515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.861515] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.074355] env[69499]: INFO networking_nsxv3.common.synchronization [req-286736e2-4f74-418a-85b4-c9b96b8f200d req-e681cd0c-5187-4a70-bc47-d408d02da762 tempest-ServerDiagnosticsNegativeTest-1018444580 tempest-ServerDiagnosticsNegativeTest-1018444580-project-member] Enqueued Resource ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a with Priority: HIGHEST for action security_group_members [ 592.074355] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a with Priority: HIGHEST for action security_group_members [ 592.074355] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.074355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.074355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.074355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.074910] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.074910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.074910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.074910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.074910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.074910] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.259527] env[69499]: INFO networking_nsxv3.common.synchronization [None req-5226a882-3247-4cb3-9da2-b7b0a71fd164 tempest-ServersWithSpecificFlavorTestJSON-328556625 tempest-ServersWithSpecificFlavorTestJSON-328556625-project-member] Enqueued Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_rules [ 592.259780] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_rules [ 592.260711] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8579ac1e-c68a-42fa-957e-e205942d2fbc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.265385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.382538] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.382688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.382790] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.383093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.383192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.383292] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc already deleted. [ 592.383401] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.383525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.383774] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.383857] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.579606] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.580260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.580343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.580576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.580671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.580876] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.581013] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.581094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.581473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.581553] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.581643] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a already deleted. [ 592.581726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.610021] env[69499]: INFO networking_nsxv3.common.synchronization [req-d5f13856-53c6-41fd-afd8-8381652375df req-aa0d217c-a7e8-4f93-a489-fca73203ade5 service nova] Enqueued Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_rules [ 592.610021] env[69499]: INFO networking_nsxv3.common.synchronization [req-d5f13856-53c6-41fd-afd8-8381652375df req-aa0d217c-a7e8-4f93-a489-fca73203ade5 service nova] Enqueued Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_members [ 592.610021] env[69499]: INFO networking_nsxv3.common.synchronization [req-d5f13856-53c6-41fd-afd8-8381652375df req-aa0d217c-a7e8-4f93-a489-fca73203ade5 service nova] Enqueued Resource ID: 96b723bd-3da4-4330-8ae1-f6fb37a8300b with Priority: HIGHEST for action port [ 592.610021] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_rules [ 592.610021] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_members [ 592.610021] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b723bd-3da4-4330-8ae1-f6fb37a8300b with Priority: HIGHEST for action port [ 592.610921] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.611067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.611120] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.611356] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.611430] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.612453] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.612453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.612621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.612663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.612789] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.612872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.613056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.613134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.613190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.613272] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.615612] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-96b723bd-3da4-4330-8ae1-f6fb37a8300b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.615715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96b723bd-3da4-4330-8ae1-f6fb37a8300b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.616154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96b723bd-3da4-4330-8ae1-f6fb37a8300b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.616154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96b723bd-3da4-4330-8ae1-f6fb37a8300b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.616154] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96b723bd-3da4-4330-8ae1-f6fb37a8300b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.795200] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.796025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.798381] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.798381] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.798381] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.798381] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.798381] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.798381] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.798381] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.798381] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 592.798381] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.798381] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.798381] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.798381] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 592.798844] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.799341] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.816920] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.817423] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 592.817423] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.817630] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.818176] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-302d0124-7de5-40b7-b053-542d50ffbbd2 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.818429] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-302d0124-7de5-40b7-b053-542d50ffbbd2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.818582] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-302d0124-7de5-40b7-b053-542d50ffbbd2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.819185] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-302d0124-7de5-40b7-b053-542d50ffbbd2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.819185] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('302d0124-7de5-40b7-b053-542d50ffbbd2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.903406] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.903406] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.903406] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.903896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.903896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.903896] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc already deleted. [ 592.903896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.979290] env[69499]: INFO networking_nsxv3.common.synchronization [req-af6329f3-4db0-44ac-a29e-5bd3e36f849c req-01f415fd-29fa-4494-bef7-7c26942004ff service nova] Enqueued Resource ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc with Priority: HIGHEST for action security_group_rules [ 592.979290] env[69499]: INFO networking_nsxv3.common.synchronization [req-af6329f3-4db0-44ac-a29e-5bd3e36f849c req-01f415fd-29fa-4494-bef7-7c26942004ff service nova] Enqueued Resource ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc with Priority: HIGHEST for action security_group_members [ 592.979290] env[69499]: INFO networking_nsxv3.common.synchronization [req-af6329f3-4db0-44ac-a29e-5bd3e36f849c req-01f415fd-29fa-4494-bef7-7c26942004ff service nova] Enqueued Resource ID: 5f3fd6d5-547b-4244-9906-52d6ce2478c4 with Priority: HIGHEST for action port [ 592.979698] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc with Priority: HIGHEST for action security_group_rules [ 592.979952] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc with Priority: HIGHEST for action security_group_members [ 592.980212] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f3fd6d5-547b-4244-9906-52d6ce2478c4 with Priority: HIGHEST for action port [ 592.980623] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.981372] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.981372] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.981372] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.981372] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.982879] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.982879] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.982879] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.983153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.983709] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.983709] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.983709] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.983709] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.984035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.984097] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.984975] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f3fd6d5-547b-4244-9906-52d6ce2478c4 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.984975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f3fd6d5-547b-4244-9906-52d6ce2478c4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.985458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f3fd6d5-547b-4244-9906-52d6ce2478c4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.985458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f3fd6d5-547b-4244-9906-52d6ce2478c4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.985458] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f3fd6d5-547b-4244-9906-52d6ce2478c4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.124164] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.124164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.130045] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.131489] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96b723bd-3da4-4330-8ae1-f6fb37a8300b with status ACTIVE [ 593.131489] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.131489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.131489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.131489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.131489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.133937] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.134088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.134152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.134334] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.134417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.134737] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.135174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.135174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.135174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.135303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.135303] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96b723bd-3da4-4330-8ae1-f6fb37a8300b is going to be updated. [ 593.160669] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.160669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.160669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.160669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.160669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.160669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96b723bd-3da4-4330-8ae1-f6fb37a8300b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.323931] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.323931] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.323931] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.323931] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.323931] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.323931] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 302d0124-7de5-40b7-b053-542d50ffbbd2 not found, creating... [ 593.323931] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.323931] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.323931] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.323931] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.323931] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.325901] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.326284] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.326474] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.326875] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.327427] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.327512] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 302d0124-7de5-40b7-b053-542d50ffbbd2 is going to be created. [ 593.351631] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.351631] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.351631] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.351631] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.351631] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.351631] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-302d0124-7de5-40b7-b053-542d50ffbbd2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.487395] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.489629] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.489896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.490249] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f3fd6d5-547b-4244-9906-52d6ce2478c4 with status ACTIVE [ 593.490638] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.491169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.491240] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.491450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.491628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.491856] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.491940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.492015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.492189] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.492270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.492538] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.492538] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.492612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.492730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.492809] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.492891] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f3fd6d5-547b-4244-9906-52d6ce2478c4 is going to be updated. [ 593.517743] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.517886] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.517976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.518300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.518377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.518520] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f3fd6d5-547b-4244-9906-52d6ce2478c4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.641157] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.703400] env[69499]: INFO networking_nsxv3.common.synchronization [None req-c0de4280-dde8-4c85-90db-ce0d5469cf15 None None] Enqueued Resource ID: c18c185a-13c5-44d4-819a-fd49b198e703 with Priority: HIGHEST for action port [ 593.704743] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c18c185a-13c5-44d4-819a-fd49b198e703 with Priority: HIGHEST for action port [ 593.704743] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-c18c185a-13c5-44d4-819a-fd49b198e703 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.704743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c18c185a-13c5-44d4-819a-fd49b198e703" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.704743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c18c185a-13c5-44d4-819a-fd49b198e703" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.704743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c18c185a-13c5-44d4-819a-fd49b198e703" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.706882] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c18c185a-13c5-44d4-819a-fd49b198e703',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.992316] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.145025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.145025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.145025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.145025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.145025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.145025] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 is going to be created. [ 594.177508] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.177661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.177729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.177962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.178184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.187410] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: UNINITIALIZED for 2s [ 594.209632] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c18c185a-13c5-44d4-819a-fd49b198e703 [ 594.209855] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.209996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.210083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.210305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.210420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.210519] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c18c185a-13c5-44d4-819a-fd49b198e703 already deleted. [ 594.210602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c18c185a-13c5-44d4-819a-fd49b198e703" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.501997] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.501997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.501997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.501997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.501997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.501997] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc is going to be created. [ 594.520294] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.520412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.520412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.520611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.520766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.530577] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc in Status: UNINITIALIZED for 2s [ 594.612431] env[69499]: INFO networking_nsxv3.common.synchronization [req-286736e2-4f74-418a-85b4-c9b96b8f200d req-2304dc76-13cf-4dbb-9cb9-e0eb6f4ccf99 service nova] Enqueued Resource ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a with Priority: HIGHEST for action security_group_rules [ 594.612431] env[69499]: INFO networking_nsxv3.common.synchronization [req-286736e2-4f74-418a-85b4-c9b96b8f200d req-2304dc76-13cf-4dbb-9cb9-e0eb6f4ccf99 service nova] Enqueued Resource ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a with Priority: HIGHEST for action security_group_members [ 594.612431] env[69499]: INFO networking_nsxv3.common.synchronization [req-286736e2-4f74-418a-85b4-c9b96b8f200d req-2304dc76-13cf-4dbb-9cb9-e0eb6f4ccf99 service nova] Enqueued Resource ID: 302d0124-7de5-40b7-b053-542d50ffbbd2 with Priority: HIGHEST for action port [ 594.612431] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a with Priority: HIGHEST for action security_group_rules [ 594.612431] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a with Priority: HIGHEST for action security_group_members [ 594.612431] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 302d0124-7de5-40b7-b053-542d50ffbbd2 with Priority: HIGHEST for action port [ 594.612431] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.612431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.612431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.612431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.612431] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.613138] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.613138] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.613138] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.616919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.616919] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.616919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.616919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.616919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.616919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.616919] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.616919] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-302d0124-7de5-40b7-b053-542d50ffbbd2 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.616919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-302d0124-7de5-40b7-b053-542d50ffbbd2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.616919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-302d0124-7de5-40b7-b053-542d50ffbbd2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.616919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-302d0124-7de5-40b7-b053-542d50ffbbd2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.616919] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('302d0124-7de5-40b7-b053-542d50ffbbd2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.119996] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.119996] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.119996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.119996] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 302d0124-7de5-40b7-b053-542d50ffbbd2 with status ACTIVE [ 595.119996] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.119996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.119996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.119996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.119996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.119996] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.119996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.119996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.119996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.119996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.122470] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.122470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.122470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.122470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.122470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.122470] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 302d0124-7de5-40b7-b053-542d50ffbbd2 is going to be updated. [ 595.145045] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.145045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.145045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.145045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.145045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.145045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-302d0124-7de5-40b7-b053-542d50ffbbd2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.333714] env[69499]: INFO networking_nsxv3.common.synchronization [None req-b696b9c8-02ac-4e77-8505-9349ff02a4e9 None None] Enqueued Resource ID: 8ee1a4f8-1761-46c5-ba33-a8b2fffe10b6 with Priority: HIGHEST for action port [ 595.334310] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ee1a4f8-1761-46c5-ba33-a8b2fffe10b6 with Priority: HIGHEST for action port [ 595.334643] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ee1a4f8-1761-46c5-ba33-a8b2fffe10b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.334766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ee1a4f8-1761-46c5-ba33-a8b2fffe10b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.334830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ee1a4f8-1761-46c5-ba33-a8b2fffe10b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.335644] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ee1a4f8-1761-46c5-ba33-a8b2fffe10b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.335729] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ee1a4f8-1761-46c5-ba33-a8b2fffe10b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.620556] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.707958] env[69499]: INFO networking_nsxv3.common.synchronization [None req-370c1c5f-a43c-40ff-9c3b-c772ee46b655 None None] Enqueued Resource ID: 794776c0-1a5a-4fc1-bdd7-88a05803faa5 with Priority: HIGHEST for action port [ 595.708816] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794776c0-1a5a-4fc1-bdd7-88a05803faa5 with Priority: HIGHEST for action port [ 595.709433] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-794776c0-1a5a-4fc1-bdd7-88a05803faa5 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.709764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-794776c0-1a5a-4fc1-bdd7-88a05803faa5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.709807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-794776c0-1a5a-4fc1-bdd7-88a05803faa5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.711089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-794776c0-1a5a-4fc1-bdd7-88a05803faa5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.711089] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('794776c0-1a5a-4fc1-bdd7-88a05803faa5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.841734] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ee1a4f8-1761-46c5-ba33-a8b2fffe10b6 [ 595.841989] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.842133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.842201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.842409] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.842501] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.842583] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ee1a4f8-1761-46c5-ba33-a8b2fffe10b6 already deleted. [ 595.843468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ee1a4f8-1761-46c5-ba33-a8b2fffe10b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.123679] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.123679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.123679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.124085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.124085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.124085] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a is going to be created. [ 596.146933] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.147187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.147406] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.148151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.148151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.156491] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a in Status: UNINITIALIZED for 2s [ 596.196560] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: SUCCESS [ 596.196997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.200631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.200631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.200631] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.200631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.200631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.200631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.200631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.200631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.200631] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.212380] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 794776c0-1a5a-4fc1-bdd7-88a05803faa5 [ 596.212380] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.213123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.213123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.213123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.213123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.213123] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:794776c0-1a5a-4fc1-bdd7-88a05803faa5 already deleted. [ 596.213123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-794776c0-1a5a-4fc1-bdd7-88a05803faa5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.539996] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc in Status: SUCCESS [ 596.540219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.540385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.540611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.540800] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.540916] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.540979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.541149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.541233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.541325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.541415] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.704689] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.704848] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.706559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.710018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.710018] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.710018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.710018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.710018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.710018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.710018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.710018] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.710018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.710018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.710018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.710018] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.710018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.710018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.710018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.710018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.710018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.711308] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.045397] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.045397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.045397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.045397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.045397] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.045397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.045397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.045397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.045397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.045397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.045814] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.045814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.045814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.045814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.045940] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.045980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.046087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.046365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.046365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.046365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.046495] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.183765] env[69499]: INFO networking_nsxv3.common.synchronization [req-2f66a0ef-9c43-414b-89a3-2c7c59be3165 req-dda9f5d1-5c1c-4fff-ae96-ade2033f8d9b tempest-ImagesTestJSON-490670806 tempest-ImagesTestJSON-490670806-project-member] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 597.183765] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 597.185892] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.185892] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.185892] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.185892] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.185892] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.186208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.186208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.186318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.186490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.186616] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.214444] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e860a997-ace0-45f9-bc64-b9fbf2d50c35: rpc.has_security_group_logging(os_id): False [ 597.231543] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.231718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.231777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.231994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.232096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.232298] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.232426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.232496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.233219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.233321] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.233731] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.233731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.233731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.233905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.234798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.234888] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.234981] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.235052] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.235251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.235325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.235373] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 is going to be created. [ 597.303416] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.303416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.303416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.303416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.303416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.318543] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: IN_PROGRESS for 2s [ 597.552346] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc: rpc.has_security_group_logging(os_id): False [ 597.569906] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.570076] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.570155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.570366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.570458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.570905] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.570905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.570905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.571132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.571132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.571357] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.571475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.571537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.571690] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.571769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.571957] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.572067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.572127] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.572267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.572345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.572427] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc is going to be created. [ 597.640586] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.640586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.640586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.640586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.640586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.653444] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc in Status: IN_PROGRESS for 2s [ 597.690241] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.690241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.690241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.690241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.690241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.690241] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.690241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.690241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.690241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.690241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.690241] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de already deleted. [ 597.690241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.166016] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a in Status: SUCCESS [ 598.166235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.166401] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.166624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.166894] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.167478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.167478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.167478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.167478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.167478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.167642] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.352610] env[69499]: INFO networking_nsxv3.common.synchronization [None req-d0175e44-9690-436f-958a-7e37260bc620 None None] Enqueued Resource ID: e8f68734-7461-4ee3-8bf7-fe3935c91d3b with Priority: HIGHEST for action port [ 598.352867] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8f68734-7461-4ee3-8bf7-fe3935c91d3b with Priority: HIGHEST for action port [ 598.353573] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8f68734-7461-4ee3-8bf7-fe3935c91d3b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.355175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8f68734-7461-4ee3-8bf7-fe3935c91d3b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.355175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8f68734-7461-4ee3-8bf7-fe3935c91d3b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.355175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8f68734-7461-4ee3-8bf7-fe3935c91d3b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.355175] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8f68734-7461-4ee3-8bf7-fe3935c91d3b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.671653] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.671920] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.672024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.672173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.672341] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.672440] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.672656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.672845] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.672947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.673058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.673218] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.673318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.673380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.673524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.673672] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.673762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.673823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.674374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.674374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.674505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.674630] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.858844] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8f68734-7461-4ee3-8bf7-fe3935c91d3b [ 598.858844] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.858844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.858844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.858844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.858844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.858844] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8f68734-7461-4ee3-8bf7-fe3935c91d3b already deleted. [ 598.858844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8f68734-7461-4ee3-8bf7-fe3935c91d3b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.984570] env[69499]: INFO networking_nsxv3.common.synchronization [None req-b145304d-bed4-4053-9365-5148ab49092c None None] Enqueued Resource ID: f04000e8-8bf2-4aed-9253-04153360e6f0 with Priority: HIGHEST for action port [ 598.984873] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f04000e8-8bf2-4aed-9253-04153360e6f0 with Priority: HIGHEST for action port [ 598.985423] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-f04000e8-8bf2-4aed-9253-04153360e6f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.985548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f04000e8-8bf2-4aed-9253-04153360e6f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.985662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f04000e8-8bf2-4aed-9253-04153360e6f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.985957] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f04000e8-8bf2-4aed-9253-04153360e6f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.985957] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f04000e8-8bf2-4aed-9253-04153360e6f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.116368] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.118527] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.119469] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.125550] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.125877] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.126075] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.126202] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.126450] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.126601] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.127737] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 599.127737] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.127737] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.127737] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.127737] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 599.127737] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.127737] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.147952] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.147952] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 599.147952] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.147952] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.148207] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-4c19e69b-b9d0-4903-9097-48939d4d2614 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.148363] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-4c19e69b-b9d0-4903-9097-48939d4d2614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.148530] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-4c19e69b-b9d0-4903-9097-48939d4d2614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.148786] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-4c19e69b-b9d0-4903-9097-48939d4d2614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.148918] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c19e69b-b9d0-4903-9097-48939d4d2614',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.177561] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a: rpc.has_security_group_logging(os_id): False [ 599.197024] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.197147] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.198029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.198029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.198029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.198029] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.198029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.198029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.198029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.198302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.198302] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.198373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.198403] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.198530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.198602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.198774] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.198869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.199152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.200285] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.200285] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.200285] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a is going to be created. [ 599.256975] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.256975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.256975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.256975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.256975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.267048] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a in Status: IN_PROGRESS for 2s [ 599.334961] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: SUCCESS [ 599.335237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.489897] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f04000e8-8bf2-4aed-9253-04153360e6f0 [ 599.489897] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.489897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.489897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.489897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.489897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.489897] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f04000e8-8bf2-4aed-9253-04153360e6f0 already deleted. [ 599.489897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f04000e8-8bf2-4aed-9253-04153360e6f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.497690] env[69499]: INFO networking_nsxv3.common.synchronization [None req-511df41a-312a-4863-a7d0-b49d04d98842 None None] Enqueued Resource ID: 27bcfea1-8586-4a98-b80e-a3263425fbe9 with Priority: HIGHEST for action port [ 599.497690] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27bcfea1-8586-4a98-b80e-a3263425fbe9 with Priority: HIGHEST for action port [ 599.498237] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-27bcfea1-8586-4a98-b80e-a3263425fbe9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.498356] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27bcfea1-8586-4a98-b80e-a3263425fbe9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.498420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27bcfea1-8586-4a98-b80e-a3263425fbe9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.498665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27bcfea1-8586-4a98-b80e-a3263425fbe9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.500072] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27bcfea1-8586-4a98-b80e-a3263425fbe9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.571595] env[69499]: INFO networking_nsxv3.common.synchronization [req-6de3ac69-c4bb-492d-8409-f08bf04f9905 req-eab1a20d-5317-4993-8d55-c7db39f0d993 tempest-MigrationsAdminTest-725814107 tempest-MigrationsAdminTest-725814107-project-member] Enqueued Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_members [ 599.572118] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_members [ 599.572940] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.572940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.572940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.573347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.573890] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.574058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.574624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.574711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.575433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.575433] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.652475] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.652701] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.652830] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.656340] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.656340] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.656340] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 4c19e69b-b9d0-4903-9097-48939d4d2614 not found, creating... [ 599.656340] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.656340] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.656340] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.656340] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.656340] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.656340] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.656340] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.656693] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.656693] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.656693] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.656693] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 4c19e69b-b9d0-4903-9097-48939d4d2614 is going to be created. [ 599.678903] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc in Status: SUCCESS [ 599.679166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.680792] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.680999] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.681136] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.681575] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.681806] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.682801] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-4c19e69b-b9d0-4903-9097-48939d4d2614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.002774] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27bcfea1-8586-4a98-b80e-a3263425fbe9 [ 600.002987] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.003159] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.003204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.003418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.003507] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.003619] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27bcfea1-8586-4a98-b80e-a3263425fbe9 already deleted. [ 600.003714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27bcfea1-8586-4a98-b80e-a3263425fbe9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.080515] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.080684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.080788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.080968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.081178] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.081373] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.081373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.081539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.081589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.081664] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.081814] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c already deleted. [ 600.081814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.696588] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.698069] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.698306] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.698603] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.698882] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.699595] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.699595] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.700744] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.700744] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.701062] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 600.701174] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.701291] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.701403] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.701518] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 600.701626] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.701791] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.719564] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.719663] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 600.719883] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.720115] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.720833] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-302ba471-4ed4-410f-b64f-f7024f367733 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.720833] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-302ba471-4ed4-410f-b64f-f7024f367733" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.720833] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-302ba471-4ed4-410f-b64f-f7024f367733" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.721193] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-302ba471-4ed4-410f-b64f-f7024f367733" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.721313] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('302ba471-4ed4-410f-b64f-f7024f367733',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.228920] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.228920] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.229127] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.229284] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.229450] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.229609] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 302ba471-4ed4-410f-b64f-f7024f367733 not found, creating... [ 601.229955] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.230841] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.230841] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.230841] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.230841] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.230841] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.231199] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.231233] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.231597] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.231597] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.231733] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 302ba471-4ed4-410f-b64f-f7024f367733 is going to be created. [ 601.243484] env[69499]: INFO networking_nsxv3.common.synchronization [None req-ea1cf6e9-435d-437a-a880-a5023ca9f2a5 None None] Enqueued Resource ID: 07a89f6f-f1ae-4572-be7d-3cfdcdd19ade with Priority: HIGHEST for action port [ 601.244154] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07a89f6f-f1ae-4572-be7d-3cfdcdd19ade with Priority: HIGHEST for action port [ 601.244416] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-07a89f6f-f1ae-4572-be7d-3cfdcdd19ade taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.244533] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07a89f6f-f1ae-4572-be7d-3cfdcdd19ade" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.244600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07a89f6f-f1ae-4572-be7d-3cfdcdd19ade" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.244899] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07a89f6f-f1ae-4572-be7d-3cfdcdd19ade" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.244968] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07a89f6f-f1ae-4572-be7d-3cfdcdd19ade',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.251145] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.251539] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.251986] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.252329] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.252767] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.252859] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-302ba471-4ed4-410f-b64f-f7024f367733" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.279403] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a in Status: SUCCESS [ 601.279829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.508865] env[69499]: INFO networking_nsxv3.common.synchronization [req-2f66a0ef-9c43-414b-89a3-2c7c59be3165 req-15983215-467a-49a7-ad5c-c0ce57ec184f service nova] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_rules [ 601.509063] env[69499]: INFO networking_nsxv3.common.synchronization [req-2f66a0ef-9c43-414b-89a3-2c7c59be3165 req-15983215-467a-49a7-ad5c-c0ce57ec184f service nova] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 601.509265] env[69499]: INFO networking_nsxv3.common.synchronization [req-2f66a0ef-9c43-414b-89a3-2c7c59be3165 req-15983215-467a-49a7-ad5c-c0ce57ec184f service nova] Enqueued Resource ID: 4c19e69b-b9d0-4903-9097-48939d4d2614 with Priority: HIGHEST for action port [ 601.509881] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_rules [ 601.510166] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 601.510380] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c19e69b-b9d0-4903-9097-48939d4d2614 with Priority: HIGHEST for action port [ 601.510630] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.510768] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.510833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.511215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.511215] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.512649] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.512788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.513504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.513812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.513964] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.514093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.514173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.514325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.514485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.514520] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.515504] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c19e69b-b9d0-4903-9097-48939d4d2614 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.515645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c19e69b-b9d0-4903-9097-48939d4d2614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.515739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c19e69b-b9d0-4903-9097-48939d4d2614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.515909] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c19e69b-b9d0-4903-9097-48939d4d2614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.515990] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c19e69b-b9d0-4903-9097-48939d4d2614',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.752278] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07a89f6f-f1ae-4572-be7d-3cfdcdd19ade [ 601.752278] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.752278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.752278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.752278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.752278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.752278] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07a89f6f-f1ae-4572-be7d-3cfdcdd19ade already deleted. [ 601.752278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07a89f6f-f1ae-4572-be7d-3cfdcdd19ade" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.978187] env[69499]: INFO networking_nsxv3.common.synchronization [None req-5a64aea5-5800-4365-86c3-dea7afd63856 None None] Enqueued Resource ID: 228abbfa-3488-4c83-a83d-d0f918c78286 with Priority: HIGHEST for action port [ 601.978187] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 228abbfa-3488-4c83-a83d-d0f918c78286 with Priority: HIGHEST for action port [ 601.978393] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-228abbfa-3488-4c83-a83d-d0f918c78286 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.980519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-228abbfa-3488-4c83-a83d-d0f918c78286" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.980606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-228abbfa-3488-4c83-a83d-d0f918c78286" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.980861] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-228abbfa-3488-4c83-a83d-d0f918c78286" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.980953] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('228abbfa-3488-4c83-a83d-d0f918c78286',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.018421] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.018515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.018652] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.022547] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c19e69b-b9d0-4903-9097-48939d4d2614 with status ACTIVE [ 602.022883] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.023057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.023178] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.026318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.026318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.026318] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.026318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.026318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.026318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.026318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.026318] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.026318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.026318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.026318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.026318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.026318] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c19e69b-b9d0-4903-9097-48939d4d2614 is going to be updated. [ 602.054611] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.054611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.054611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.054611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.054611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.054611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c19e69b-b9d0-4903-9097-48939d4d2614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.082353] env[69499]: INFO networking_nsxv3.common.synchronization [None req-6e74a26c-15f0-4601-aed3-667f76ef445d None None] Enqueued Resource ID: b3c64b53-d944-4f5e-bd5d-52dc52881518 with Priority: HIGHEST for action port [ 602.084707] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3c64b53-d944-4f5e-bd5d-52dc52881518 with Priority: HIGHEST for action port [ 602.086124] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3c64b53-d944-4f5e-bd5d-52dc52881518 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.086124] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3c64b53-d944-4f5e-bd5d-52dc52881518" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.086124] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3c64b53-d944-4f5e-bd5d-52dc52881518" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.086124] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3c64b53-d944-4f5e-bd5d-52dc52881518" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.086124] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3c64b53-d944-4f5e-bd5d-52dc52881518',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.486019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 228abbfa-3488-4c83-a83d-d0f918c78286 [ 602.487219] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.487219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.487219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.487219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.487219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.487219] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:228abbfa-3488-4c83-a83d-d0f918c78286 already deleted. [ 602.487219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-228abbfa-3488-4c83-a83d-d0f918c78286" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.502344] env[69499]: INFO networking_nsxv3.common.synchronization [None req-5f24ad7e-c0fe-49fe-833a-97fa2dac7f5c None None] Enqueued Resource ID: 12a37bdd-30e9-47ec-99bd-8b74ed2d2330 with Priority: HIGHEST for action port [ 602.502800] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a37bdd-30e9-47ec-99bd-8b74ed2d2330 with Priority: HIGHEST for action port [ 602.503158] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-12a37bdd-30e9-47ec-99bd-8b74ed2d2330 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.504039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12a37bdd-30e9-47ec-99bd-8b74ed2d2330" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.504039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12a37bdd-30e9-47ec-99bd-8b74ed2d2330" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.504039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12a37bdd-30e9-47ec-99bd-8b74ed2d2330" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.504039] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12a37bdd-30e9-47ec-99bd-8b74ed2d2330',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.520810] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.587927] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3c64b53-d944-4f5e-bd5d-52dc52881518 [ 602.588243] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.588382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.588453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.588671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.588754] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.588847] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3c64b53-d944-4f5e-bd5d-52dc52881518 already deleted. [ 602.588926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3c64b53-d944-4f5e-bd5d-52dc52881518" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.912470] env[69499]: INFO networking_nsxv3.common.synchronization [None req-5ec21029-c4a9-4ed4-a60b-b68d70c4ea50 None None] Enqueued Resource ID: 403ee51e-29bd-4447-ac7f-daaa4d7f1584 with Priority: HIGHEST for action port [ 602.912762] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 403ee51e-29bd-4447-ac7f-daaa4d7f1584 with Priority: HIGHEST for action port [ 602.913318] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-403ee51e-29bd-4447-ac7f-daaa4d7f1584 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.913440] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-403ee51e-29bd-4447-ac7f-daaa4d7f1584" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.913497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-403ee51e-29bd-4447-ac7f-daaa4d7f1584" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.913760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-403ee51e-29bd-4447-ac7f-daaa4d7f1584" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.913857] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('403ee51e-29bd-4447-ac7f-daaa4d7f1584',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.011483] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12a37bdd-30e9-47ec-99bd-8b74ed2d2330 [ 603.011483] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.011483] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.011483] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.011734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.011767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.011935] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12a37bdd-30e9-47ec-99bd-8b74ed2d2330 already deleted. [ 603.012069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12a37bdd-30e9-47ec-99bd-8b74ed2d2330" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.024412] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.026832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.026832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.026832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.026832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.026832] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be created. [ 603.047703] env[69499]: INFO networking_nsxv3.common.synchronization [req-abbebea1-e552-43fd-a54d-7cf37066e224 req-8edb3fc3-57b7-4f7a-b733-fa0f33ebe877 tempest-VolumesAssistedSnapshotsTest-628391310 tempest-VolumesAssistedSnapshotsTest-628391310-project-member] Enqueued Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGHEST for action security_group_members [ 603.049251] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.049416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.049463] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.049663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.050052] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.055628] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGHEST for action security_group_members [ 603.055628] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-032cabed-a789-4100-95a3-6e4998fdb5cc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.055628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.055628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.055628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.055628] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.055628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.055628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.055628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.055628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.055628] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032cabed-a789-4100-95a3-6e4998fdb5cc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.065017] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: UNINITIALIZED for 2s [ 603.423316] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 403ee51e-29bd-4447-ac7f-daaa4d7f1584 [ 603.423316] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.423316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.423316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.423316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.423316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.423722] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:403ee51e-29bd-4447-ac7f-daaa4d7f1584 already deleted. [ 603.423722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-403ee51e-29bd-4447-ac7f-daaa4d7f1584" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.558233] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.558508] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.558627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.558934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.561158] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.561437] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.561554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.561616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.561799] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.561951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.562075] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032cabed-a789-4100-95a3-6e4998fdb5cc already deleted. [ 603.562132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.748183] env[69499]: INFO networking_nsxv3.common.synchronization [req-b3ace222-beac-4096-8497-312ef1f3490a req-103cf724-ce18-4f5f-b65d-e7352488bd58 tempest-ListImageFiltersTestJSON-1801888174 tempest-ListImageFiltersTestJSON-1801888174-project-member] Enqueued Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_members [ 603.748183] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_members [ 603.748813] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba52dd6-05d0-4283-ba0e-107ad8c10157 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.749095] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.749095] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.749332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.749713] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.749713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.749713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.750173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.750173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.750173] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.083547] env[69499]: INFO networking_nsxv3.common.synchronization [req-6de3ac69-c4bb-492d-8409-f08bf04f9905 req-827801b0-8d04-4395-8341-6ac5634047b4 service nova] Enqueued Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_rules [ 604.083810] env[69499]: INFO networking_nsxv3.common.synchronization [req-6de3ac69-c4bb-492d-8409-f08bf04f9905 req-827801b0-8d04-4395-8341-6ac5634047b4 service nova] Enqueued Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_members [ 604.083988] env[69499]: INFO networking_nsxv3.common.synchronization [req-6de3ac69-c4bb-492d-8409-f08bf04f9905 req-827801b0-8d04-4395-8341-6ac5634047b4 service nova] Enqueued Resource ID: 302ba471-4ed4-410f-b64f-f7024f367733 with Priority: HIGHEST for action port [ 604.084789] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_rules [ 604.084789] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_members [ 604.084789] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 302ba471-4ed4-410f-b64f-f7024f367733 with Priority: HIGHEST for action port [ 604.089438] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.089954] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.089954] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.089954] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.090208] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.093026] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.093026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.093026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.093026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.093026] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.093026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.093026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.093026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.093026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.094377] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.094377] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-302ba471-4ed4-410f-b64f-f7024f367733 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.094377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-302ba471-4ed4-410f-b64f-f7024f367733" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.094377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-302ba471-4ed4-410f-b64f-f7024f367733" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.094377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-302ba471-4ed4-410f-b64f-f7024f367733" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.094535] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('302ba471-4ed4-410f-b64f-f7024f367733',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.255812] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.256032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.256111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.256412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.256412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.256627] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.256735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.257815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.257815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.257815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.257815] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 already deleted. [ 604.257815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.394269] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.394269] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.394791] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.394791] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.394941] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.395431] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.395626] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.395891] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.396044] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.396264] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 604.396368] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.396487] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.396631] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.396758] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 604.396880] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.397012] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.422464] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.422636] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 604.422803] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.423122] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.423352] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-8d84340b-545a-4c8d-b33d-f3e53ccbe7d6 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.423964] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-8d84340b-545a-4c8d-b33d-f3e53ccbe7d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.424074] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-8d84340b-545a-4c8d-b33d-f3e53ccbe7d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.424413] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-8d84340b-545a-4c8d-b33d-f3e53ccbe7d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.424561] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d84340b-545a-4c8d-b33d-f3e53ccbe7d6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.596768] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.596923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.597139] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.598057] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 302ba471-4ed4-410f-b64f-f7024f367733 with status ACTIVE [ 604.598192] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.598317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.598394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.598588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.598677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.598846] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.598942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.599132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.599175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.599236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.599501] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.599501] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.599603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.599697] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.599758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.599848] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 302ba471-4ed4-410f-b64f-f7024f367733 is going to be updated. [ 604.620100] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.620247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.620318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.620517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.620651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.621778] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-302ba471-4ed4-410f-b64f-f7024f367733" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.930672] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.930912] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.931076] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.931797] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.931797] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.931797] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 8d84340b-545a-4c8d-b33d-f3e53ccbe7d6 not found, creating... [ 604.931988] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.932067] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.932187] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.932406] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.932577] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.932876] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.933048] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.933167] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.933378] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.933513] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.933657] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 8d84340b-545a-4c8d-b33d-f3e53ccbe7d6 is going to be created. [ 604.952570] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.952755] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.952858] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.953159] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.953398] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.953678] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-8d84340b-545a-4c8d-b33d-f3e53ccbe7d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.078968] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 605.079228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.079451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.079677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.079876] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.080018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.080090] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.080310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.080424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.080528] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.080569] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.102112] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.590022] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.590022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.590022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.590022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.590022] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.590022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.590022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.590022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.590022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.590022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.590022] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.590022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.590022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.590022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.590022] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.590022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.590624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.590624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.591159] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.591265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.591362] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.604658] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.604829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.604903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.605188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.605247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.605951] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c is going to be created. [ 605.631844] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.631844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.631844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.631844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.631844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.641305] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: UNINITIALIZED for 2s [ 605.696096] env[69499]: INFO networking_nsxv3.common.synchronization [None req-e03be66f-7d56-4019-bf87-4ac59202cb83 None None] Enqueued Resource ID: 86444c40-1d67-4c8c-8100-08722e6ce037 with Priority: HIGHEST for action port [ 605.696096] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86444c40-1d67-4c8c-8100-08722e6ce037 with Priority: HIGHEST for action port [ 605.696096] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-86444c40-1d67-4c8c-8100-08722e6ce037 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.696096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86444c40-1d67-4c8c-8100-08722e6ce037" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.696096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86444c40-1d67-4c8c-8100-08722e6ce037" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.696096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86444c40-1d67-4c8c-8100-08722e6ce037" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.696557] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86444c40-1d67-4c8c-8100-08722e6ce037',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.720117] env[69499]: INFO networking_nsxv3.common.synchronization [None req-371bb844-257d-4777-a0dd-9bd83f6258cb None None] Enqueued Resource ID: 1236b165-4a3c-4a3a-a1e1-0d9927b9905e with Priority: HIGHEST for action port [ 605.720117] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1236b165-4a3c-4a3a-a1e1-0d9927b9905e with Priority: HIGHEST for action port [ 605.720117] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-1236b165-4a3c-4a3a-a1e1-0d9927b9905e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.720117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1236b165-4a3c-4a3a-a1e1-0d9927b9905e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.721078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1236b165-4a3c-4a3a-a1e1-0d9927b9905e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.721809] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1236b165-4a3c-4a3a-a1e1-0d9927b9905e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.721809] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1236b165-4a3c-4a3a-a1e1-0d9927b9905e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.772032] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-204 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.772032] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-204" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.772032] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-204" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.772032] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-204" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.772032] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.772032] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.772032] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.773648] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.774163] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.777016] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 605.777016] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.777016] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.777016] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.777016] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 605.777016] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.777016] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.795325] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.795325] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 605.795325] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.795325] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-204" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.795325] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-875d3625-eb6d-4b71-909d-bee0ed6e0473 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.795325] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-875d3625-eb6d-4b71-909d-bee0ed6e0473" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.795325] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-875d3625-eb6d-4b71-909d-bee0ed6e0473" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.795325] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-875d3625-eb6d-4b71-909d-bee0ed6e0473" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.795325] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('875d3625-eb6d-4b71-909d-bee0ed6e0473',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.095158] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 137495f6-8f3c-475d-b71c-88971c3781de: rpc.has_security_group_logging(os_id): False [ 606.112752] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.113147] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.113147] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.113147] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.113256] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.113439] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.113542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.113605] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.113796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.113875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.114097] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.114235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.114329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.114524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.114689] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.114794] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.114890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.114952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.116204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.116299] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.116391] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be created. [ 606.175705] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.175705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.175705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.175705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.175705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.199584] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 606.199988] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86444c40-1d67-4c8c-8100-08722e6ce037 [ 606.202115] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.202115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.202115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.202115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.202115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.202115] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86444c40-1d67-4c8c-8100-08722e6ce037 already deleted. [ 606.202115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86444c40-1d67-4c8c-8100-08722e6ce037" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.224997] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1236b165-4a3c-4a3a-a1e1-0d9927b9905e [ 606.225270] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.225496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.225496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.225968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.225968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.227259] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1236b165-4a3c-4a3a-a1e1-0d9927b9905e already deleted. [ 606.227259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1236b165-4a3c-4a3a-a1e1-0d9927b9905e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.299639] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.300898] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.300898] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.300898] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.300898] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.300898] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 875d3625-eb6d-4b71-909d-bee0ed6e0473 not found, creating... [ 606.302991] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.302991] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.302991] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.302991] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.302991] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.303258] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.303258] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.304095] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.304095] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.304095] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.304095] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 875d3625-eb6d-4b71-909d-bee0ed6e0473 is going to be created. [ 606.328269] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.328269] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.328269] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.328671] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.328918] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.329169] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-875d3625-eb6d-4b71-909d-bee0ed6e0473" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.782938] env[69499]: INFO networking_nsxv3.common.synchronization [req-b3ace222-beac-4096-8497-312ef1f3490a req-85fb9205-3494-4fef-a8fc-2a92f8bbba8c service nova] Enqueued Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_rules [ 606.783137] env[69499]: INFO networking_nsxv3.common.synchronization [req-b3ace222-beac-4096-8497-312ef1f3490a req-85fb9205-3494-4fef-a8fc-2a92f8bbba8c service nova] Enqueued Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_members [ 606.783361] env[69499]: INFO networking_nsxv3.common.synchronization [req-b3ace222-beac-4096-8497-312ef1f3490a req-85fb9205-3494-4fef-a8fc-2a92f8bbba8c service nova] Enqueued Resource ID: 8d84340b-545a-4c8d-b33d-f3e53ccbe7d6 with Priority: HIGHEST for action port [ 606.783724] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_rules [ 606.783724] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_members [ 606.783724] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d84340b-545a-4c8d-b33d-f3e53ccbe7d6 with Priority: HIGHEST for action port [ 606.784759] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dba52dd6-05d0-4283-ba0e-107ad8c10157 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.784759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.784759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.785010] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.785010] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.785868] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba52dd6-05d0-4283-ba0e-107ad8c10157 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.786605] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.786605] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.786605] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.786605] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.786605] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.786605] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.786605] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.786878] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.786878] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.787543] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d84340b-545a-4c8d-b33d-f3e53ccbe7d6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.787662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d84340b-545a-4c8d-b33d-f3e53ccbe7d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.787728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d84340b-545a-4c8d-b33d-f3e53ccbe7d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.788105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d84340b-545a-4c8d-b33d-f3e53ccbe7d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.788105] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d84340b-545a-4c8d-b33d-f3e53ccbe7d6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.089382] env[69499]: INFO networking_nsxv3.common.synchronization [req-272d592a-b26a-40d3-b8cd-4b93eac1fa09 req-94132200-07b3-46f1-a37b-3fb23a5b5136 tempest-ServersWithSpecificFlavorTestJSON-328556625 tempest-ServersWithSpecificFlavorTestJSON-328556625-project-member] Enqueued Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_members [ 607.089915] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_members [ 607.090232] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8579ac1e-c68a-42fa-957e-e205942d2fbc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.090376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.090434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.090653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.090805] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.090899] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.090957] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.091629] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.091724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.091836] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.292980] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba52dd6-05d0-4283-ba0e-107ad8c10157 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.293742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.294893] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.296802] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d84340b-545a-4c8d-b33d-f3e53ccbe7d6 with status ACTIVE [ 607.296802] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.296802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.296802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.296802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.296802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.297751] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.297751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.297751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.297910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.298049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.298279] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.298411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.298498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.298678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.298784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.298905] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d84340b-545a-4c8d-b33d-f3e53ccbe7d6 is going to be updated. [ 607.319770] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.320621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.320621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.320967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.322840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.322840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d84340b-545a-4c8d-b33d-f3e53ccbe7d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.555529] env[69499]: INFO networking_nsxv3.common.synchronization [req-abbebea1-e552-43fd-a54d-7cf37066e224 req-ac4ec0ca-0efa-4407-9e58-0a3942630854 service nova] Enqueued Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGHEST for action security_group_rules [ 607.555680] env[69499]: INFO networking_nsxv3.common.synchronization [req-abbebea1-e552-43fd-a54d-7cf37066e224 req-ac4ec0ca-0efa-4407-9e58-0a3942630854 service nova] Enqueued Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGHEST for action security_group_members [ 607.555792] env[69499]: INFO networking_nsxv3.common.synchronization [req-abbebea1-e552-43fd-a54d-7cf37066e224 req-ac4ec0ca-0efa-4407-9e58-0a3942630854 service nova] Enqueued Resource ID: 875d3625-eb6d-4b71-909d-bee0ed6e0473 with Priority: HIGHEST for action port [ 607.557158] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGHEST for action security_group_rules [ 607.557158] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGHEST for action security_group_members [ 607.557158] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 875d3625-eb6d-4b71-909d-bee0ed6e0473 with Priority: HIGHEST for action port [ 607.557158] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-032cabed-a789-4100-95a3-6e4998fdb5cc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.561365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.561365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.561365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.561365] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('032cabed-a789-4100-95a3-6e4998fdb5cc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.561365] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-032cabed-a789-4100-95a3-6e4998fdb5cc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.561365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.561365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.561365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.561365] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.561365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.561365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.561365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.561365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.561365] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032cabed-a789-4100-95a3-6e4998fdb5cc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.562727] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-875d3625-eb6d-4b71-909d-bee0ed6e0473 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.562727] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-875d3625-eb6d-4b71-909d-bee0ed6e0473" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.562727] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-875d3625-eb6d-4b71-909d-bee0ed6e0473" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.562727] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-875d3625-eb6d-4b71-909d-bee0ed6e0473" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.562727] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('875d3625-eb6d-4b71-909d-bee0ed6e0473',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.594187] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.594320] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.594441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.594657] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.594743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.595297] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.595297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.595297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.595297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.595539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.595539] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc already deleted. [ 607.595539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.651067] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: SUCCESS [ 607.651952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.651952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.651952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.651952] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.652184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.652184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.652366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.652403] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.652564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.652564] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.658206] env[69499]: INFO networking_nsxv3.common.synchronization [None req-9be8565b-094c-403e-9738-4113d961a43a None None] Enqueued Resource ID: 0c8da4b1-e497-4a4d-9099-04a2a5f257b6 with Priority: HIGHEST for action port [ 607.658467] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8da4b1-e497-4a4d-9099-04a2a5f257b6 with Priority: HIGHEST for action port [ 607.659092] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c8da4b1-e497-4a4d-9099-04a2a5f257b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.659250] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c8da4b1-e497-4a4d-9099-04a2a5f257b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.659291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c8da4b1-e497-4a4d-9099-04a2a5f257b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.659869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c8da4b1-e497-4a4d-9099-04a2a5f257b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.660399] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c8da4b1-e497-4a4d-9099-04a2a5f257b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.802039] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.892550] env[69499]: INFO networking_nsxv3.common.synchronization [None req-770dcd6c-9b48-4d6d-b9b5-2cf315b97f2c None None] Enqueued Resource ID: 0f88f6c6-d227-4ee6-927d-84a1e1451a81 with Priority: HIGHEST for action port [ 607.895018] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f88f6c6-d227-4ee6-927d-84a1e1451a81 with Priority: HIGHEST for action port [ 607.895018] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f88f6c6-d227-4ee6-927d-84a1e1451a81 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.895018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f88f6c6-d227-4ee6-927d-84a1e1451a81" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.895018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f88f6c6-d227-4ee6-927d-84a1e1451a81" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.895018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f88f6c6-d227-4ee6-927d-84a1e1451a81" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.895018] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f88f6c6-d227-4ee6-927d-84a1e1451a81',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.064318] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-032cabed-a789-4100-95a3-6e4998fdb5cc taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.064480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.065630] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('032cabed-a789-4100-95a3-6e4998fdb5cc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.066233] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 875d3625-eb6d-4b71-909d-bee0ed6e0473 with status ACTIVE [ 608.066429] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.066577] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.066639] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.067226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.067226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.067443] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.067586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.067671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.067836] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.068250] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.068555] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.068555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.068780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.068780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.069200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.069200] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 875d3625-eb6d-4b71-909d-bee0ed6e0473 is going to be updated. [ 608.090900] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.091049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.091049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.091385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.091385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.091561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-875d3625-eb6d-4b71-909d-bee0ed6e0473" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.137710] env[69499]: INFO networking_nsxv3.common.synchronization [None req-10a1318c-419b-4492-ae87-da762df414b5 None None] Enqueued Resource ID: 51c48002-4fb2-4540-b5fd-b5e45b88200c with Priority: HIGHEST for action port [ 608.138822] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51c48002-4fb2-4540-b5fd-b5e45b88200c with Priority: HIGHEST for action port [ 608.139602] env[69499]: INFO networking_nsxv3.common.synchronization [None req-b6aeb8cb-97c8-4df9-a844-3864bc4a559c None None] Enqueued Resource ID: 128f5d50-bd12-404d-9411-40cb3e95fa0e with Priority: HIGHEST for action port [ 608.139910] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-51c48002-4fb2-4540-b5fd-b5e45b88200c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.140046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51c48002-4fb2-4540-b5fd-b5e45b88200c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.140118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51c48002-4fb2-4540-b5fd-b5e45b88200c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.141072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51c48002-4fb2-4540-b5fd-b5e45b88200c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.141072] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51c48002-4fb2-4540-b5fd-b5e45b88200c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.141647] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 128f5d50-bd12-404d-9411-40cb3e95fa0e with Priority: HIGHEST for action port [ 608.141758] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-128f5d50-bd12-404d-9411-40cb3e95fa0e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.141847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-128f5d50-bd12-404d-9411-40cb3e95fa0e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.142105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-128f5d50-bd12-404d-9411-40cb3e95fa0e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.142105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-128f5d50-bd12-404d-9411-40cb3e95fa0e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.142171] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('128f5d50-bd12-404d-9411-40cb3e95fa0e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.155783] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.155783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.155783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.156687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.156687] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.156687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.156687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.156687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.156687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.156687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.157111] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.157111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.157111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.157111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.157310] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.157310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.157310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.157432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.158521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.158521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.158521] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.162688] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c8da4b1-e497-4a4d-9099-04a2a5f257b6 [ 608.162688] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.162688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.165029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.165029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.165029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.165029] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c8da4b1-e497-4a4d-9099-04a2a5f257b6 already deleted. [ 608.165029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c8da4b1-e497-4a4d-9099-04a2a5f257b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.188867] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.189103] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-403" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.189514] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-403" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.189649] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-403" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.189914] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.190623] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.190732] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.191899] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.192124] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.192402] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 608.192541] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 608.192681] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 608.192821] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 608.192973] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 608.193241] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 608.193457] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 608.218172] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 608.218486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.227833] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 608.228020] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 608.228476] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 608.228476] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-403" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.228750] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-bfef426d-dcfb-4222-b3bb-cfb62b9d3d88 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.228850] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-bfef426d-dcfb-4222-b3bb-cfb62b9d3d88" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.229174] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-bfef426d-dcfb-4222-b3bb-cfb62b9d3d88" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.229377] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-bfef426d-dcfb-4222-b3bb-cfb62b9d3d88" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.229583] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfef426d-dcfb-4222-b3bb-cfb62b9d3d88',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.306099] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.306380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.306380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.306516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.306609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.306708] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 is going to be created. [ 608.330232] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.330437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.330437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.330643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.330806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.340282] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: UNINITIALIZED for 2s [ 608.398480] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f88f6c6-d227-4ee6-927d-84a1e1451a81 [ 608.398720] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.398857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.398924] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.399158] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.399492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.399492] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f88f6c6-d227-4ee6-927d-84a1e1451a81 already deleted. [ 608.399492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f88f6c6-d227-4ee6-927d-84a1e1451a81" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.572099] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('032cabed-a789-4100-95a3-6e4998fdb5cc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.643854] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51c48002-4fb2-4540-b5fd-b5e45b88200c [ 608.644098] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.644224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.644290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.644496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.644581] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.644673] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51c48002-4fb2-4540-b5fd-b5e45b88200c already deleted. [ 608.644751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51c48002-4fb2-4540-b5fd-b5e45b88200c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.647345] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 128f5d50-bd12-404d-9411-40cb3e95fa0e [ 608.647545] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.647738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.647815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.647997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.648092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.648185] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:128f5d50-bd12-404d-9411-40cb3e95fa0e already deleted. [ 608.648261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-128f5d50-bd12-404d-9411-40cb3e95fa0e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.659749] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94d2e4ea-db97-4a0c-91d6-635a39a38e5c: rpc.has_security_group_logging(os_id): False [ 608.679450] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.679929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.679929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.679929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.680121] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.680187] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.680287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.680348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.680497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.680571] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.680752] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.680995] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.680995] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.681316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.681316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.681316] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.681545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.681545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.681545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.681914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.681914] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c is going to be created. [ 608.741764] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.741764] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.741764] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.741764] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.741764] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.741764] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port bfef426d-dcfb-4222-b3bb-cfb62b9d3d88 not found, creating... [ 608.741764] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.741764] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.741764] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.741764] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.741764] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.742341] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.742341] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.742341] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.745532] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.745895] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.749343] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: bfef426d-dcfb-4222-b3bb-cfb62b9d3d88 is going to be created. [ 608.749343] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.749343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.749343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.750266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.750730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.770037] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: IN_PROGRESS for 2s [ 608.773638] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.773903] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.774097] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.774354] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.774626] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.774988] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-bfef426d-dcfb-4222-b3bb-cfb62b9d3d88" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.079110] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.079225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.079225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.079767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.079767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.079767] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032cabed-a789-4100-95a3-6e4998fdb5cc is going to be created. [ 609.103792] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.104186] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.104186] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.104455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.105119] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.115077] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032cabed-a789-4100-95a3-6e4998fdb5cc in Status: UNINITIALIZED for 2s [ 609.246061] env[69499]: INFO networking_nsxv3.common.synchronization [None req-cc587ba2-74af-46c6-8fda-395fe38e4f26 None None] Enqueued Resource ID: d0794b49-5d01-4332-98e5-4abd041531a8 with Priority: HIGHEST for action port [ 609.246351] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0794b49-5d01-4332-98e5-4abd041531a8 with Priority: HIGHEST for action port [ 609.247027] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0794b49-5d01-4332-98e5-4abd041531a8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.247194] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0794b49-5d01-4332-98e5-4abd041531a8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.247248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0794b49-5d01-4332-98e5-4abd041531a8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.247487] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0794b49-5d01-4332-98e5-4abd041531a8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.247565] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0794b49-5d01-4332-98e5-4abd041531a8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.611817] env[69499]: INFO networking_nsxv3.common.synchronization [None req-a50ae291-41f1-48bc-a523-3a2edff657e4 None None] Enqueued Resource ID: ea43e869-a620-4af5-9184-12ab28e7f858 with Priority: HIGHEST for action port [ 609.612226] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea43e869-a620-4af5-9184-12ab28e7f858 with Priority: HIGHEST for action port [ 609.612715] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea43e869-a620-4af5-9184-12ab28e7f858 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.612846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea43e869-a620-4af5-9184-12ab28e7f858" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.612915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea43e869-a620-4af5-9184-12ab28e7f858" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.618345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea43e869-a620-4af5-9184-12ab28e7f858" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.618345] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea43e869-a620-4af5-9184-12ab28e7f858',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.756441] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0794b49-5d01-4332-98e5-4abd041531a8 [ 609.756441] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.756441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.756441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.761093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.761093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.761093] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0794b49-5d01-4332-98e5-4abd041531a8 already deleted. [ 609.761093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0794b49-5d01-4332-98e5-4abd041531a8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.003880] env[69499]: INFO networking_nsxv3.common.synchronization [req-272d592a-b26a-40d3-b8cd-4b93eac1fa09 req-a1bd4a37-a9c5-42cd-97e9-7b39b6533299 service nova] Enqueued Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_rules [ 610.004057] env[69499]: INFO networking_nsxv3.common.synchronization [req-272d592a-b26a-40d3-b8cd-4b93eac1fa09 req-a1bd4a37-a9c5-42cd-97e9-7b39b6533299 service nova] Enqueued Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_members [ 610.004367] env[69499]: INFO networking_nsxv3.common.synchronization [req-272d592a-b26a-40d3-b8cd-4b93eac1fa09 req-a1bd4a37-a9c5-42cd-97e9-7b39b6533299 service nova] Enqueued Resource ID: bfef426d-dcfb-4222-b3bb-cfb62b9d3d88 with Priority: HIGHEST for action port [ 610.004469] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_rules [ 610.004770] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_members [ 610.004770] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfef426d-dcfb-4222-b3bb-cfb62b9d3d88 with Priority: HIGHEST for action port [ 610.005460] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8579ac1e-c68a-42fa-957e-e205942d2fbc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.005578] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.005639] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.005889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.007131] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.007131] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8579ac1e-c68a-42fa-957e-e205942d2fbc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.007131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.007131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.007593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.007593] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.007593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.007751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.007751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.007848] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.007930] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.009433] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfef426d-dcfb-4222-b3bb-cfb62b9d3d88 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.009572] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfef426d-dcfb-4222-b3bb-cfb62b9d3d88" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.009624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfef426d-dcfb-4222-b3bb-cfb62b9d3d88" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.009806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfef426d-dcfb-4222-b3bb-cfb62b9d3d88" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.009894] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfef426d-dcfb-4222-b3bb-cfb62b9d3d88',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.130396] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea43e869-a620-4af5-9184-12ab28e7f858 [ 610.130766] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.130948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.131035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.131258] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.131346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.131441] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea43e869-a620-4af5-9184-12ab28e7f858 already deleted. [ 610.131518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea43e869-a620-4af5-9184-12ab28e7f858" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.353268] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: SUCCESS [ 610.353604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.354698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.354698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.354698] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.354698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.354698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.354698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.354698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.355275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.355275] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.512190] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.513377] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8579ac1e-c68a-42fa-957e-e205942d2fbc taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.513513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.515937] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfef426d-dcfb-4222-b3bb-cfb62b9d3d88 with status ACTIVE [ 610.516172] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.516312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.516402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.516618] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.516704] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.516922] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.517058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.517120] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.517933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.517933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.517933] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.517933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.517933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.517933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.517933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.518337] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfef426d-dcfb-4222-b3bb-cfb62b9d3d88 is going to be updated. [ 610.542500] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.542706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.542775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.543021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.543241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.543370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfef426d-dcfb-4222-b3bb-cfb62b9d3d88" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.784268] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: SUCCESS [ 610.784692] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.865041] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba52dd6-05d0-4283-ba0e-107ad8c10157 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.865262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.865262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.865490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.865655] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.865772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.865827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.866140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.866253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.866253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.866416] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba52dd6-05d0-4283-ba0e-107ad8c10157 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.866508] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.866595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.866827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.866827] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.866966] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.866966] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.867217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.867217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.867416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.867416] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.021083] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.125333] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032cabed-a789-4100-95a3-6e4998fdb5cc in Status: SUCCESS [ 611.125333] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.125560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.125692] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.127046] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.127046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.127046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.127046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.127046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.127046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.127046] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('032cabed-a789-4100-95a3-6e4998fdb5cc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.214742] env[69499]: INFO networking_nsxv3.common.synchronization [req-390e8363-ceb8-4b30-ac26-e9475b1703e5 req-1a57ae66-2152-4aed-8e0a-3fa89d897d88 tempest-DeleteServersAdminTestJSON-118096704 tempest-DeleteServersAdminTestJSON-118096704-project-admin] Enqueued Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_members [ 611.215334] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_members [ 611.215821] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.216108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.216232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.216592] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.216675] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.216831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.217029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.217129] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.217282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.217429] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.370212] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dba52dd6-05d0-4283-ba0e-107ad8c10157: rpc.has_security_group_logging(os_id): False [ 611.387298] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.387501] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.387565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.387754] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.387852] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.388107] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.388222] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.388283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.388500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.388584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.388695] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.388805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.388860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.389018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.393245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.393508] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.393619] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.393687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.393835] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.393919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.394029] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 is going to be created. [ 611.456956] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.457171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.457238] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.457449] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.457634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.469045] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: IN_PROGRESS for 2s [ 611.522526] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.522768] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.522768] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.522987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.523102] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.523156] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc is going to be created. [ 611.566705] env[69499]: INFO networking_nsxv3.common.synchronization [None req-6dd975cf-aef1-48c8-a25a-8d531e434651 None None] Enqueued Resource ID: afb5303d-337e-460a-ae6e-5941f3eadf7d with Priority: HIGHEST for action port [ 611.567376] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afb5303d-337e-460a-ae6e-5941f3eadf7d with Priority: HIGHEST for action port [ 611.567695] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-afb5303d-337e-460a-ae6e-5941f3eadf7d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.567823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afb5303d-337e-460a-ae6e-5941f3eadf7d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.567883] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afb5303d-337e-460a-ae6e-5941f3eadf7d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.568459] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afb5303d-337e-460a-ae6e-5941f3eadf7d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.568611] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afb5303d-337e-460a-ae6e-5941f3eadf7d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.580634] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.580879] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.581395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.581778] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.582061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.594857] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc in Status: UNINITIALIZED for 2s [ 611.629434] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('032cabed-a789-4100-95a3-6e4998fdb5cc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.720105] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.720475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.720559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.720786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.720885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.721111] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.721239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.721276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.721421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.721495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.721587] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 is going to be updated. [ 611.752267] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.752552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.752552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.753074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.753074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.763892] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: IN_PROGRESS for 2s [ 611.930030] env[69499]: INFO networking_nsxv3.common.synchronization [req-bd868a19-c309-4571-bf53-ed602f60ee5e req-4d9382c5-6682-4431-947d-80103025e826 tempest-ImagesNegativeTestJSON-1129831825 tempest-ImagesNegativeTestJSON-1129831825-project-member] Enqueued Resource ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc with Priority: HIGHEST for action security_group_members [ 611.930030] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc with Priority: HIGHEST for action security_group_members [ 611.930030] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.930030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.930030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.930030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.931237] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.931237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.931386] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.931446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.931549] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.931862] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.071495] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afb5303d-337e-460a-ae6e-5941f3eadf7d [ 612.071735] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.071893] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.071961] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.072278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.072278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.072424] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afb5303d-337e-460a-ae6e-5941f3eadf7d already deleted. [ 612.072424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afb5303d-337e-460a-ae6e-5941f3eadf7d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.131280] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 032cabed-a789-4100-95a3-6e4998fdb5cc: rpc.has_security_group_logging(os_id): False [ 612.149633] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.149734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.149734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.149938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.150046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.150287] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.150390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.150455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.150653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.150762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.150988] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 032cabed-a789-4100-95a3-6e4998fdb5cc is going to be created. [ 612.225378] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.225586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.225647] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.225849] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.226122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.239034] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 032cabed-a789-4100-95a3-6e4998fdb5cc in Status: IN_PROGRESS for 2s [ 612.433509] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.433667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.433730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.433954] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.434069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.434275] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.434380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.434437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.434643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.434711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.434765] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc is going to be updated. [ 612.469209] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.469541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.469541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.469680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.469760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.482978] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc in Status: IN_PROGRESS for 2s [ 612.785022] env[69499]: INFO networking_nsxv3.common.synchronization [None req-e069c0a9-ebab-40b7-b69e-88f38e818ef7 None None] Enqueued Resource ID: 2f42b43d-1029-44c5-bf7f-49c24655549c with Priority: HIGHEST for action port [ 612.785022] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f42b43d-1029-44c5-bf7f-49c24655549c with Priority: HIGHEST for action port [ 612.785022] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f42b43d-1029-44c5-bf7f-49c24655549c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.785022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f42b43d-1029-44c5-bf7f-49c24655549c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.785022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f42b43d-1029-44c5-bf7f-49c24655549c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.786687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f42b43d-1029-44c5-bf7f-49c24655549c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.786687] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f42b43d-1029-44c5-bf7f-49c24655549c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.289916] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f42b43d-1029-44c5-bf7f-49c24655549c [ 613.290272] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.290360] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.290426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.290624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.290711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.290807] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f42b43d-1029-44c5-bf7f-49c24655549c already deleted. [ 613.291173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f42b43d-1029-44c5-bf7f-49c24655549c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.483688] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: SUCCESS [ 613.484889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.604183] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc in Status: SUCCESS [ 613.604624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.604624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.604810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.604999] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.605136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.605202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.605363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.605449] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.605925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.605925] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.772435] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: SUCCESS [ 613.772631] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 deletion is rescheduled due to dependency. [ 613.772738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.107505] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.256202] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 032cabed-a789-4100-95a3-6e4998fdb5cc in Status: SUCCESS [ 614.256202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.496908] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc in Status: SUCCESS [ 614.496908] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc deletion is rescheduled due to dependency. [ 614.496908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.609831] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8579ac1e-c68a-42fa-957e-e205942d2fbc: rpc.has_security_group_logging(os_id): False [ 614.629235] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.629554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.629554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.629697] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.629764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.630053] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.630185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.630273] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.630416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.630496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.630804] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc is going to be created. [ 614.719923] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.720229] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.720229] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.720523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.720576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.731557] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc in Status: IN_PROGRESS for 2s [ 615.291269] env[69499]: INFO networking_nsxv3.common.synchronization [None req-43f25a86-33b8-436b-a423-1e2a38641499 tempest-VolumesAdminNegativeTest-1747404511 tempest-VolumesAdminNegativeTest-1747404511-project-member] Enqueued Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGHEST for action security_group_rules [ 615.294422] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGHEST for action security_group_rules [ 615.294807] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c134d579-1162-46e0-bee7-73f3403c9135 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.294952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.295073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.295371] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.295465] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c134d579-1162-46e0-bee7-73f3403c9135',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.480843] env[69499]: INFO networking_nsxv3.common.synchronization [None req-ce9fbb02-98b0-47b0-91db-0af57600f50d tempest-VolumesAdminNegativeTest-1747404511 tempest-VolumesAdminNegativeTest-1747404511-project-member] Enqueued Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGHEST for action security_group_rules [ 615.482187] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGHEST for action security_group_rules [ 615.482187] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c134d579-1162-46e0-bee7-73f3403c9135 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.482187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.815182] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.815616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.815616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.815616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.815976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.815976] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c134d579-1162-46e0-bee7-73f3403c9135 already deleted. [ 615.815976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.816132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.816283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.816363] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c134d579-1162-46e0-bee7-73f3403c9135',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.865355] env[69499]: INFO networking_nsxv3.common.synchronization [req-db20beea-aa10-4559-877c-89d938042bce req-1f049e6d-cd94-4ba2-a3ec-bfb44c813435 tempest-ServerDiagnosticsNegativeTest-1018444580 tempest-ServerDiagnosticsNegativeTest-1018444580-project-member] Enqueued Resource ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a with Priority: HIGHEST for action security_group_members [ 615.865355] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a with Priority: HIGHEST for action security_group_members [ 615.865355] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.865355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.865355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.866429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.866597] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.866701] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.866763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.866930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.867035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.867121] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.006792] env[69499]: INFO networking_nsxv3.common.synchronization [req-acc7e570-aca8-4ce0-94aa-7c36ddb84840 req-d34c2a59-408b-40b1-8c28-ba4d3c6e6d8e tempest-ListImageFiltersTestJSON-1801888174 tempest-ListImageFiltersTestJSON-1801888174-project-member] Enqueued Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_members [ 616.011269] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_members [ 616.011269] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba52dd6-05d0-4283-ba0e-107ad8c10157 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.011269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.011269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.011269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.011269] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.011269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.011269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.011269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.011269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.011269] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.336066] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.336322] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.336438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.336625] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.337038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.337104] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c134d579-1162-46e0-bee7-73f3403c9135 already deleted. [ 616.337339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.369099] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.369279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.369392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.369574] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.369685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.369888] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.369992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.370077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.370307] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.370456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.370584] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a is going to be updated. [ 616.397320] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.398016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.398016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.398016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.398016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.407422] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a in Status: IN_PROGRESS for 2s [ 616.516020] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.624731] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.624731] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.624731] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.625385] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.625732] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.626120] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.626320] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.626623] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.626977] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.627302] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 616.627473] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.627657] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.627815] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.627978] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 616.628155] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.628383] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.649160] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.649536] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 616.649536] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.649715] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.650762] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-d46565ba-aa0b-4a52-aa03-c12e7cbe5840 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.651013] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-d46565ba-aa0b-4a52-aa03-c12e7cbe5840" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.651151] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-d46565ba-aa0b-4a52-aa03-c12e7cbe5840" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.651529] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-d46565ba-aa0b-4a52-aa03-c12e7cbe5840" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.651678] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d46565ba-aa0b-4a52-aa03-c12e7cbe5840',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.744806] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc in Status: SUCCESS [ 616.744806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.015750] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.155799] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.156204] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.156366] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.156671] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.156821] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.157018] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port d46565ba-aa0b-4a52-aa03-c12e7cbe5840 not found, creating... [ 617.158512] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.158704] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.158824] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.159120] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.159792] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.159792] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.159792] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.161183] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.161427] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.161572] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.161722] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: d46565ba-aa0b-4a52-aa03-c12e7cbe5840 is going to be created. [ 617.190348] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.190348] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.190348] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.190348] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.190348] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.190348] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-d46565ba-aa0b-4a52-aa03-c12e7cbe5840" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.244597] env[69499]: INFO networking_nsxv3.common.synchronization [None req-1894a430-a0ab-49be-942f-aa723a60ee33 None None] Enqueued Resource ID: 0c58e78a-56c9-4144-8922-7635989c5123 with Priority: HIGHEST for action port [ 617.244848] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c58e78a-56c9-4144-8922-7635989c5123 with Priority: HIGHEST for action port [ 617.245429] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c58e78a-56c9-4144-8922-7635989c5123 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.245552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c58e78a-56c9-4144-8922-7635989c5123" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.245620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c58e78a-56c9-4144-8922-7635989c5123" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.245864] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c58e78a-56c9-4144-8922-7635989c5123" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.245951] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c58e78a-56c9-4144-8922-7635989c5123',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.519449] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.519591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.519701] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.520054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.520054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.521089] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 is going to be updated. [ 617.550497] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.550670] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.551347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.551347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.551347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.567760] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: IN_PROGRESS for 2s [ 617.654820] env[69499]: INFO networking_nsxv3.common.synchronization [None req-b9309dc5-8abb-4e49-8ded-a9d2da27b0fa None None] Enqueued Resource ID: a82e0227-b49b-43b9-9f74-d0dd5c52ea1d with Priority: HIGHEST for action port [ 617.654909] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a82e0227-b49b-43b9-9f74-d0dd5c52ea1d with Priority: HIGHEST for action port [ 617.655335] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-a82e0227-b49b-43b9-9f74-d0dd5c52ea1d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.656235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a82e0227-b49b-43b9-9f74-d0dd5c52ea1d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.656235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a82e0227-b49b-43b9-9f74-d0dd5c52ea1d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.656894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a82e0227-b49b-43b9-9f74-d0dd5c52ea1d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.657115] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a82e0227-b49b-43b9-9f74-d0dd5c52ea1d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.749546] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c58e78a-56c9-4144-8922-7635989c5123 [ 617.749882] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.750014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.750058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.750252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.750464] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.750464] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c58e78a-56c9-4144-8922-7635989c5123 already deleted. [ 617.750554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c58e78a-56c9-4144-8922-7635989c5123" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.939469] env[69499]: INFO networking_nsxv3.common.synchronization [None req-81242c5c-8ae6-4e91-8c6d-4e2afd6eef9c None None] Enqueued Resource ID: 43687b24-f02c-4007-ad9e-e4107da23d63 with Priority: HIGHEST for action port [ 617.940392] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43687b24-f02c-4007-ad9e-e4107da23d63 with Priority: HIGHEST for action port [ 617.940932] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-43687b24-f02c-4007-ad9e-e4107da23d63 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.940932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43687b24-f02c-4007-ad9e-e4107da23d63" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.940932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43687b24-f02c-4007-ad9e-e4107da23d63" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.941118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43687b24-f02c-4007-ad9e-e4107da23d63" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.941327] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43687b24-f02c-4007-ad9e-e4107da23d63',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.160859] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a82e0227-b49b-43b9-9f74-d0dd5c52ea1d [ 618.161128] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.161280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.161318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.161551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.161611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.161691] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a82e0227-b49b-43b9-9f74-d0dd5c52ea1d already deleted. [ 618.161773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a82e0227-b49b-43b9-9f74-d0dd5c52ea1d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.420665] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a in Status: SUCCESS [ 618.420665] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a deletion is rescheduled due to dependency. [ 618.420665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.443454] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43687b24-f02c-4007-ad9e-e4107da23d63 [ 618.443613] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.443844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.443844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.444416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.444416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.444416] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43687b24-f02c-4007-ad9e-e4107da23d63 already deleted. [ 618.444416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43687b24-f02c-4007-ad9e-e4107da23d63" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.781122] env[69499]: INFO networking_nsxv3.common.synchronization [req-acc7e570-aca8-4ce0-94aa-7c36ddb84840 req-d843eba4-50ac-4c56-abf3-dbeef7d8a68b service nova] Enqueued Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_rules [ 618.781328] env[69499]: INFO networking_nsxv3.common.synchronization [req-acc7e570-aca8-4ce0-94aa-7c36ddb84840 req-d843eba4-50ac-4c56-abf3-dbeef7d8a68b service nova] Enqueued Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_members [ 618.781519] env[69499]: INFO networking_nsxv3.common.synchronization [req-acc7e570-aca8-4ce0-94aa-7c36ddb84840 req-d843eba4-50ac-4c56-abf3-dbeef7d8a68b service nova] Enqueued Resource ID: d46565ba-aa0b-4a52-aa03-c12e7cbe5840 with Priority: HIGHEST for action port [ 618.782110] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_rules [ 618.782269] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_members [ 618.782409] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46565ba-aa0b-4a52-aa03-c12e7cbe5840 with Priority: HIGHEST for action port [ 618.782701] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dba52dd6-05d0-4283-ba0e-107ad8c10157 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.782855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.782931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.784827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.785158] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.786264] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba52dd6-05d0-4283-ba0e-107ad8c10157 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.786264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.786417] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-d46565ba-aa0b-4a52-aa03-c12e7cbe5840 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.787030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d46565ba-aa0b-4a52-aa03-c12e7cbe5840" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.787030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d46565ba-aa0b-4a52-aa03-c12e7cbe5840" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.787030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d46565ba-aa0b-4a52-aa03-c12e7cbe5840" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.787030] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d46565ba-aa0b-4a52-aa03-c12e7cbe5840',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.928255] env[69499]: INFO networking_nsxv3.common.synchronization [None req-d51dce05-453e-4ee0-bfc9-578e5691a869 None None] Enqueued Resource ID: 3216db96-dbbf-49d7-ae46-50518b97634e with Priority: HIGHEST for action port [ 618.928683] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3216db96-dbbf-49d7-ae46-50518b97634e with Priority: HIGHEST for action port [ 618.932718] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-3216db96-dbbf-49d7-ae46-50518b97634e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.932718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3216db96-dbbf-49d7-ae46-50518b97634e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.932718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3216db96-dbbf-49d7-ae46-50518b97634e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.932718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3216db96-dbbf-49d7-ae46-50518b97634e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.932718] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3216db96-dbbf-49d7-ae46-50518b97634e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.289393] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba52dd6-05d0-4283-ba0e-107ad8c10157 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.289393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.291203] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d46565ba-aa0b-4a52-aa03-c12e7cbe5840 with status ACTIVE [ 619.291203] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.291203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.291203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.291203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.291203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.291203] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.291203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.291203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.291203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.291203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.291203] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.291654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.291654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.291654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.291654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.291770] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d46565ba-aa0b-4a52-aa03-c12e7cbe5840 is going to be updated. [ 619.312608] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.312881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.313209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.313505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.313685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.313890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d46565ba-aa0b-4a52-aa03-c12e7cbe5840" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.436421] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3216db96-dbbf-49d7-ae46-50518b97634e [ 619.436806] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.436938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.436983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.437318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.437318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.437416] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3216db96-dbbf-49d7-ae46-50518b97634e already deleted. [ 619.437680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3216db96-dbbf-49d7-ae46-50518b97634e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.580067] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: SUCCESS [ 619.580319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.580480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.580702] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.580891] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.581035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.581110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.581308] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.581366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.581419] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.086743] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.363280] env[69499]: INFO networking_nsxv3.common.synchronization [None req-b8f6312f-d1ae-46fb-9ae1-6e2e7ea40f26 tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_rules [ 620.363814] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_rules [ 620.366716] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.366829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.369137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.369137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.369137] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.570851] env[69499]: INFO networking_nsxv3.common.synchronization [None req-d5429c32-7ab3-4f64-9100-a4dd424d0e03 tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_rules [ 620.571410] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_rules [ 620.571703] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.571803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.590778] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.889929] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.890186] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.890317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.890676] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.890953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.890953] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd already deleted. [ 620.891090] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.891814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.891814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.891814] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.964385] env[69499]: INFO networking_nsxv3.common.synchronization [req-e3844e1b-a365-45e9-b131-78f6be069281 req-5578fdd4-69ca-4672-a15a-3c722f7598be tempest-TenantUsagesTestJSON-1286836440 tempest-TenantUsagesTestJSON-1286836440-project-member] Enqueued Resource ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 with Priority: HIGHEST for action security_group_members [ 620.964514] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 with Priority: HIGHEST for action security_group_members [ 620.965084] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.966804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.967755] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.968066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.970111] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.970111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.970111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.970111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.970111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.970111] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e367a92f-7a4f-4e34-ac00-9e0a0c97dd76',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.093804] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.093986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.094128] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.094351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.094447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.094547] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 is going to be updated. [ 621.124353] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.124353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.124353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.124353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.124353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.131958] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: IN_PROGRESS for 2s [ 621.415527] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.415861] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.415861] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.415946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.416074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.416187] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd already deleted. [ 621.416274] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.473588] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.473742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.473812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.474072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.477740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.477740] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.477740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.477740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.477740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.477740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.477740] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 already deleted. [ 621.477740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.666168] env[69499]: INFO networking_nsxv3.common.synchronization [None req-d51e15ae-8c1a-40e9-a8ec-6eee42a3f460 None None] Enqueued Resource ID: bff41ab5-afdf-4988-bd2e-7d3a29bcba8c with Priority: HIGHEST for action port [ 621.666519] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff41ab5-afdf-4988-bd2e-7d3a29bcba8c with Priority: HIGHEST for action port [ 621.668502] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-bff41ab5-afdf-4988-bd2e-7d3a29bcba8c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.668695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bff41ab5-afdf-4988-bd2e-7d3a29bcba8c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.668740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bff41ab5-afdf-4988-bd2e-7d3a29bcba8c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.669434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bff41ab5-afdf-4988-bd2e-7d3a29bcba8c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.669558] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bff41ab5-afdf-4988-bd2e-7d3a29bcba8c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.787357] env[69499]: INFO networking_nsxv3.common.synchronization [None req-5e8b88e0-495c-4619-967b-d882a6404c27 None None] Enqueued Resource ID: c5ab4602-42fc-4cbe-8a88-8efa84582934 with Priority: HIGHEST for action port [ 621.788848] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ab4602-42fc-4cbe-8a88-8efa84582934 with Priority: HIGHEST for action port [ 621.789194] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5ab4602-42fc-4cbe-8a88-8efa84582934 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.789389] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5ab4602-42fc-4cbe-8a88-8efa84582934" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.789389] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5ab4602-42fc-4cbe-8a88-8efa84582934" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.789634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5ab4602-42fc-4cbe-8a88-8efa84582934" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.789713] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5ab4602-42fc-4cbe-8a88-8efa84582934',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.171667] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bff41ab5-afdf-4988-bd2e-7d3a29bcba8c [ 622.171925] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.172059] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.172147] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.172383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.172553] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.172606] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bff41ab5-afdf-4988-bd2e-7d3a29bcba8c already deleted. [ 622.172682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bff41ab5-afdf-4988-bd2e-7d3a29bcba8c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.271200] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.271200] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.271200] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.271200] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.271200] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.271200] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.271749] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.272127] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.272403] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.272728] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 622.272965] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.273230] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.273468] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.273734] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 622.273985] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.274259] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.300025] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.300025] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 622.300025] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.300025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.300025] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-f424564b-e46e-413c-b279-f75a24a4d2f4 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.300025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-f424564b-e46e-413c-b279-f75a24a4d2f4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.300025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-f424564b-e46e-413c-b279-f75a24a4d2f4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.300025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-f424564b-e46e-413c-b279-f75a24a4d2f4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.300025] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f424564b-e46e-413c-b279-f75a24a4d2f4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.300778] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5ab4602-42fc-4cbe-8a88-8efa84582934 [ 622.301505] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.301702] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.302314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.302314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.302314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.302314] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5ab4602-42fc-4cbe-8a88-8efa84582934 already deleted. [ 622.302561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5ab4602-42fc-4cbe-8a88-8efa84582934" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.322112] env[69499]: INFO networking_nsxv3.common.synchronization [req-7b7ead23-d54d-4c0b-a9d8-cb73150f4351 req-74263363-43c7-473d-aa39-195db22b4256 tempest-SecurityGroupRulesTestJSON-1235550905 tempest-SecurityGroupRulesTestJSON-1235550905-project-member] Enqueued Resource ID: ae39c554-f201-4086-846d-2379f62534fe with Priority: HIGHEST for action security_group_rules [ 622.322468] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae39c554-f201-4086-846d-2379f62534fe with Priority: HIGHEST for action security_group_rules [ 622.322767] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae39c554-f201-4086-846d-2379f62534fe taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.322891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae39c554-f201-4086-846d-2379f62534fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.322958] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae39c554-f201-4086-846d-2379f62534fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.323838] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae39c554-f201-4086-846d-2379f62534fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.323932] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae39c554-f201-4086-846d-2379f62534fe',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.804542] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.805241] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.806263] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.806605] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.806759] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.806918] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port f424564b-e46e-413c-b279-f75a24a4d2f4 not found, creating... [ 622.807256] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.807432] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.807535] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.807794] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.807893] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.809508] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.809738] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.809826] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.810085] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.810247] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.810380] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: f424564b-e46e-413c-b279-f75a24a4d2f4 is going to be created. [ 622.832555] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.832930] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.833101] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.833915] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.834265] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.835351] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-f424564b-e46e-413c-b279-f75a24a4d2f4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.848652] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.848842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.848882] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.849802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.849802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.849802] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae39c554-f201-4086-846d-2379f62534fe already deleted. [ 622.849802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae39c554-f201-4086-846d-2379f62534fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.914138] env[69499]: INFO networking_nsxv3.common.synchronization [None req-cc3c5ac1-e8cb-4a79-9254-f5f095dbe37b None None] Enqueued Resource ID: 564b6139-be6d-4a0c-a1a4-40ff5ba70141 with Priority: HIGHEST for action port [ 622.915933] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 564b6139-be6d-4a0c-a1a4-40ff5ba70141 with Priority: HIGHEST for action port [ 622.915933] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-564b6139-be6d-4a0c-a1a4-40ff5ba70141 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.915933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-564b6139-be6d-4a0c-a1a4-40ff5ba70141" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.916280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-564b6139-be6d-4a0c-a1a4-40ff5ba70141" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.916454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-564b6139-be6d-4a0c-a1a4-40ff5ba70141" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.917868] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('564b6139-be6d-4a0c-a1a4-40ff5ba70141',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.143793] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: IN_PROGRESS for 4s [ 623.419798] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 564b6139-be6d-4a0c-a1a4-40ff5ba70141 [ 623.421888] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.421888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.421888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.421888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.421888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.421888] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:564b6139-be6d-4a0c-a1a4-40ff5ba70141 already deleted. [ 623.421888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-564b6139-be6d-4a0c-a1a4-40ff5ba70141" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.587232] env[69499]: INFO networking_nsxv3.common.synchronization [req-d4861ab3-f413-431d-a77e-32a99011e65b req-328e8636-ddfc-48b9-b0ec-bed3c931bd39 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 623.589225] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 623.589225] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.589225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.589225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.589625] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.589929] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.590171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.592192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.592192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.592192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.592192] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.089411] env[69499]: INFO networking_nsxv3.common.synchronization [req-e3844e1b-a365-45e9-b131-78f6be069281 req-7e2b3c96-5bae-4b19-8022-db61fbbd8756 service nova] Enqueued Resource ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 with Priority: HIGHEST for action security_group_rules [ 624.089684] env[69499]: INFO networking_nsxv3.common.synchronization [req-e3844e1b-a365-45e9-b131-78f6be069281 req-7e2b3c96-5bae-4b19-8022-db61fbbd8756 service nova] Enqueued Resource ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 with Priority: HIGHEST for action security_group_members [ 624.089864] env[69499]: INFO networking_nsxv3.common.synchronization [req-e3844e1b-a365-45e9-b131-78f6be069281 req-7e2b3c96-5bae-4b19-8022-db61fbbd8756 service nova] Enqueued Resource ID: f424564b-e46e-413c-b279-f75a24a4d2f4 with Priority: HIGHEST for action port [ 624.089929] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 with Priority: HIGHEST for action security_group_rules [ 624.090060] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 with Priority: HIGHEST for action security_group_members [ 624.090664] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f424564b-e46e-413c-b279-f75a24a4d2f4 with Priority: HIGHEST for action port [ 624.090803] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.090897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.090988] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.091330] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.091572] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e367a92f-7a4f-4e34-ac00-9e0a0c97dd76',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.093706] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.093706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.093706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.093706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.093706] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.093706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.093706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.093706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.093706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.093706] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e367a92f-7a4f-4e34-ac00-9e0a0c97dd76',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.095106] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-f424564b-e46e-413c-b279-f75a24a4d2f4 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.095239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f424564b-e46e-413c-b279-f75a24a4d2f4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.095239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f424564b-e46e-413c-b279-f75a24a4d2f4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.095478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f424564b-e46e-413c-b279-f75a24a4d2f4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.095478] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f424564b-e46e-413c-b279-f75a24a4d2f4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.097604] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.097705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.097757] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.097889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.097974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.098180] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.098276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.098329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.098479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.098550] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.098634] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 already deleted. [ 624.098713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.598386] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f424564b-e46e-413c-b279-f75a24a4d2f4 with status ACTIVE [ 624.598574] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.598714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.598797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.599052] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.599150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.599340] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.599441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.599506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.599661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.599738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.599928] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.600122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.600122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.600258] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.600337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.600424] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f424564b-e46e-413c-b279-f75a24a4d2f4 is going to be updated. [ 624.604377] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.604527] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.604638] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e367a92f-7a4f-4e34-ac00-9e0a0c97dd76',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.628607] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.629176] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.629264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.629474] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.629614] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.629771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f424564b-e46e-413c-b279-f75a24a4d2f4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.996097] env[69499]: INFO networking_nsxv3.common.synchronization [None req-b67e88c1-028b-4d6c-b1b0-1639612e834a None None] Enqueued Resource ID: 09f63e08-66a6-4747-91e3-9a97c17019db with Priority: HIGHEST for action port [ 624.996097] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09f63e08-66a6-4747-91e3-9a97c17019db with Priority: HIGHEST for action port [ 624.996097] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-09f63e08-66a6-4747-91e3-9a97c17019db taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.996097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09f63e08-66a6-4747-91e3-9a97c17019db" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.996097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09f63e08-66a6-4747-91e3-9a97c17019db" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.996097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09f63e08-66a6-4747-91e3-9a97c17019db" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.996097] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09f63e08-66a6-4747-91e3-9a97c17019db',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.107971] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e367a92f-7a4f-4e34-ac00-9e0a0c97dd76',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.110986] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-142 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.110986] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-142" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.113020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-142" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.113020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-142" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.113020] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.113261] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.113261] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.113492] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.113677] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.114032] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 625.114425] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.114425] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.114425] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.114587] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 625.114629] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.115510] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.134848] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.134953] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 625.135139] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.135596] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-142" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.136058] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-74a5f3d6-d559-4625-80d3-fa22d7e4367c taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.136186] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.136315] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.136678] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.136781] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74a5f3d6-d559-4625-80d3-fa22d7e4367c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.152409] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: SUCCESS [ 625.152633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.152818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.153785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.153785] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.154032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.154032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.154219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.154219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.154283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.154429] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.484829] env[69499]: INFO networking_nsxv3.common.synchronization [req-d9f2b015-86fa-4c82-b16b-8077e76ba0f8 req-76dcdad8-0354-44a4-9ebb-767252fc494b tempest-SecurityGroupRulesTestJSON-1235550905 tempest-SecurityGroupRulesTestJSON-1235550905-project-member] Enqueued Resource ID: 414279b2-0687-477c-8d98-f3c561a78eda with Priority: HIGHEST for action security_group_rules [ 625.487971] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 414279b2-0687-477c-8d98-f3c561a78eda with Priority: HIGHEST for action security_group_rules [ 625.489353] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-414279b2-0687-477c-8d98-f3c561a78eda taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.489489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-414279b2-0687-477c-8d98-f3c561a78eda" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.489833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-414279b2-0687-477c-8d98-f3c561a78eda" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.490140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-414279b2-0687-477c-8d98-f3c561a78eda" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.490275] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('414279b2-0687-477c-8d98-f3c561a78eda',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.498825] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09f63e08-66a6-4747-91e3-9a97c17019db [ 625.499125] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.499570] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.499674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.500517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.500517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.500517] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09f63e08-66a6-4747-91e3-9a97c17019db already deleted. [ 625.500731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09f63e08-66a6-4747-91e3-9a97c17019db" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.620291] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.620461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.620505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.620781] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.620863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.620918] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 is going to be created. [ 625.639624] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.641162] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.641162] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.641162] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.641162] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.641162] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 74a5f3d6-d559-4625-80d3-fa22d7e4367c not found, creating... [ 625.641473] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.641473] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.641953] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.641953] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.644526] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.644526] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.644872] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.644872] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.649019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.649019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.649019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 74a5f3d6-d559-4625-80d3-fa22d7e4367c is going to be created. [ 625.649019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.649019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.649019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.649019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.649019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.657651] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba52dd6-05d0-4283-ba0e-107ad8c10157 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.657651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.657651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.657651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.657651] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.657984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.657984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.657984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.658097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.658131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.659348] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba52dd6-05d0-4283-ba0e-107ad8c10157 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.659348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.659348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.659348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.659348] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.659348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.659348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.659348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.659348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.659348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.659793] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.667468] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 in Status: UNINITIALIZED for 2s [ 625.676188] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.676188] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.676188] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.676188] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.676188] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.676188] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.014264] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.014620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.015764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.015764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.015764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.015764] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 414279b2-0687-477c-8d98-f3c561a78eda already deleted. [ 626.015764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-414279b2-0687-477c-8d98-f3c561a78eda" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.147580] env[69499]: INFO networking_nsxv3.common.synchronization [None req-23cab19b-bd42-4409-aa7a-3bd6e765e369 tempest-AttachInterfacesUnderV243Test-812043974 tempest-AttachInterfacesUnderV243Test-812043974-project-member] Enqueued Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_rules [ 626.148311] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_rules [ 626.150765] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.150765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.150765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.150765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.151135] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.162468] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dba52dd6-05d0-4283-ba0e-107ad8c10157: rpc.has_security_group_logging(os_id): False [ 626.198267] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.198421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.198467] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.199024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.199024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.199024] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.199225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.199225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.199353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.199431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.199603] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.199701] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.199778] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.199903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.199985] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.200264] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.203410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.203410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.203410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.203410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.203410] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 is going to be updated. [ 626.276828] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.277374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.277374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.277620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.277840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.291518] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: IN_PROGRESS for 2s [ 626.471540] env[69499]: INFO networking_nsxv3.common.synchronization [None req-a5d5379e-e719-470c-a3ab-1ec3a6430f0f tempest-AttachInterfacesUnderV243Test-812043974 tempest-AttachInterfacesUnderV243Test-812043974-project-member] Enqueued Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_rules [ 626.471540] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_rules [ 626.471540] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.471540] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.647275] env[69499]: INFO networking_nsxv3.common.synchronization [req-ba335fa7-1f0b-46dc-b9b4-0011df69f0b8 req-4a56c72e-afb2-45c9-8396-45b610d04044 tempest-MultipleCreateTestJSON-19272315 tempest-MultipleCreateTestJSON-19272315-project-member] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 626.647805] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 626.648663] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.648877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.648877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.649160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.650217] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.650353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.650485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.650651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.650651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.651035] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.672968] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.672968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.672968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.672968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.673292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.673652] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 already deleted. [ 626.673859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.674263] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.674351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.674475] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.716979] env[69499]: INFO networking_nsxv3.common.synchronization [req-d4861ab3-f413-431d-a77e-32a99011e65b req-c24398cf-dba2-4297-8e7b-be6f20ca9daa service nova] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_rules [ 626.716979] env[69499]: INFO networking_nsxv3.common.synchronization [req-d4861ab3-f413-431d-a77e-32a99011e65b req-c24398cf-dba2-4297-8e7b-be6f20ca9daa service nova] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 626.716979] env[69499]: INFO networking_nsxv3.common.synchronization [req-d4861ab3-f413-431d-a77e-32a99011e65b req-c24398cf-dba2-4297-8e7b-be6f20ca9daa service nova] Enqueued Resource ID: 74a5f3d6-d559-4625-80d3-fa22d7e4367c with Priority: HIGHEST for action port [ 626.716979] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_rules [ 626.716979] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 626.716979] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74a5f3d6-d559-4625-80d3-fa22d7e4367c with Priority: HIGHEST for action port [ 626.716979] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.718146] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.719080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.720324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.720324] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.721796] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.721796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.721796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.721796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.721796] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.721796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.721796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.721796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.721796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.721796] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.725364] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-74a5f3d6-d559-4625-80d3-fa22d7e4367c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.725515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.725584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.725720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.725800] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74a5f3d6-d559-4625-80d3-fa22d7e4367c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.846043] env[69499]: INFO networking_nsxv3.common.synchronization [None req-b39f1f36-b0ab-4b4a-bef5-9db5630c29d9 None None] Enqueued Resource ID: 7cec524d-d36f-4a22-9685-7bfef7bf27f1 with Priority: HIGHEST for action port [ 626.846844] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cec524d-d36f-4a22-9685-7bfef7bf27f1 with Priority: HIGHEST for action port [ 626.847649] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cec524d-d36f-4a22-9685-7bfef7bf27f1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.847649] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cec524d-d36f-4a22-9685-7bfef7bf27f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.847809] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cec524d-d36f-4a22-9685-7bfef7bf27f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.848222] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cec524d-d36f-4a22-9685-7bfef7bf27f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.848739] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cec524d-d36f-4a22-9685-7bfef7bf27f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.155732] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.155732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.155732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.155732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.155732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.155732] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.155732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.156301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.156301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.156301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.156301] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae already deleted. [ 627.156301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.200283] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.200581] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.200635] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.200829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.200920] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.201107] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 already deleted. [ 627.201147] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.228115] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.229368] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.229889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.231180] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74a5f3d6-d559-4625-80d3-fa22d7e4367c with status ACTIVE [ 627.231180] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.231180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.231180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.231180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.231180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.231180] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.231180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.231180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.231888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.231888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.231888] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.231888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.231888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.232547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.232547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.232547] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74a5f3d6-d559-4625-80d3-fa22d7e4367c is going to be updated. [ 627.253710] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.258252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.258252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.258252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.258252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.258252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.354859] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cec524d-d36f-4a22-9685-7bfef7bf27f1 [ 627.354859] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.354859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.354859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.354859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.354859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.354859] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cec524d-d36f-4a22-9685-7bfef7bf27f1 already deleted. [ 627.354859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cec524d-d36f-4a22-9685-7bfef7bf27f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.592317] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.592640] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.592860] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.593303] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.593578] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.593762] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.593894] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.594163] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.594391] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.594709] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.594709] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.594820] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.594899] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.595626] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.595797] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.596208] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.620024] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.620024] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 627.620024] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.620024] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.620024] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.620024] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.620024] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.621194] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.621711] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.677716] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 in Status: SUCCESS [ 627.677716] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.677716] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.678564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.678638] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.678874] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.678874] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.679020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.679101] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.679191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.679362] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e367a92f-7a4f-4e34-ac00-9e0a0c97dd76',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.734899] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.125506] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.125808] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.125808] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.125998] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.126125] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.126299] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae not found, creating... [ 628.126906] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.127142] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.127221] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.127459] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.127599] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.127894] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.129599] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.129731] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.129970] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.130127] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.131104] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae is going to be created. [ 628.151773] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.152118] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.152118] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.152394] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.155984] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.155984] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.183812] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.184302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.185322] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.185322] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.185446] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.185541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.185603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.185752] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.185835] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.185924] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.186148] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.186238] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.186286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.186461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.186599] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.186693] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.186767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.186955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.187052] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.187188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.189074] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e367a92f-7a4f-4e34-ac00-9e0a0c97dd76',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.243146] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.243339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.243537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.245141] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.245141] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.245141] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be created. [ 628.246010] env[69499]: INFO networking_nsxv3.common.synchronization [None req-9447e3d8-7e66-4dcf-a075-7380a8dddf50 None None] Enqueued Resource ID: 40a959de-6c5f-47f5-8807-0a315c3928d2 with Priority: HIGHEST for action port [ 628.246698] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a959de-6c5f-47f5-8807-0a315c3928d2 with Priority: HIGHEST for action port [ 628.247891] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-40a959de-6c5f-47f5-8807-0a315c3928d2 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.247960] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40a959de-6c5f-47f5-8807-0a315c3928d2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.248063] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40a959de-6c5f-47f5-8807-0a315c3928d2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.248374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40a959de-6c5f-47f5-8807-0a315c3928d2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.248541] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40a959de-6c5f-47f5-8807-0a315c3928d2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.295036] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.295036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.295036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.295036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.295036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.310459] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: UNINITIALIZED for 2s [ 628.321693] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: SUCCESS [ 628.321693] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.692718] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e367a92f-7a4f-4e34-ac00-9e0a0c97dd76: rpc.has_security_group_logging(os_id): False [ 628.712582] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.712582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.712582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.712582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.712582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.712582] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.712582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.712582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.712582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.712582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.712582] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.712582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.712582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.713269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.713269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.713269] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.714842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.714943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.715370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.715486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.715548] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 is going to be created. [ 628.751509] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40a959de-6c5f-47f5-8807-0a315c3928d2 [ 628.751771] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.751932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.751984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.752227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.752314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.752410] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40a959de-6c5f-47f5-8807-0a315c3928d2 already deleted. [ 628.752801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40a959de-6c5f-47f5-8807-0a315c3928d2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.772308] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.772475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.772555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.772778] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.773032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.786202] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 in Status: IN_PROGRESS for 2s [ 628.821187] env[69499]: INFO networking_nsxv3.common.synchronization [req-ba335fa7-1f0b-46dc-b9b4-0011df69f0b8 req-b3231e06-04dc-4a44-8360-c42ebb408511 tempest-MultipleCreateTestJSON-19272315 tempest-MultipleCreateTestJSON-19272315-project-member] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 628.821187] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 628.822435] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.823055] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.823385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.824038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.825539] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.825539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.825539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.826303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.826303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.827346] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.332259] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.583089] env[69499]: INFO networking_nsxv3.common.synchronization [req-ba335fa7-1f0b-46dc-b9b4-0011df69f0b8 req-8f37d0ff-4d8d-42fc-b636-f0b672af2f77 service nova] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_rules [ 629.583089] env[69499]: INFO networking_nsxv3.common.synchronization [req-ba335fa7-1f0b-46dc-b9b4-0011df69f0b8 req-8f37d0ff-4d8d-42fc-b636-f0b672af2f77 service nova] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 629.583089] env[69499]: INFO networking_nsxv3.common.synchronization [req-ba335fa7-1f0b-46dc-b9b4-0011df69f0b8 req-8f37d0ff-4d8d-42fc-b636-f0b672af2f77 service nova] Enqueued Resource ID: 820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae with Priority: HIGHEST for action port [ 629.583435] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_rules [ 629.584430] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 629.584430] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae with Priority: HIGHEST for action port [ 629.584430] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.584430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.584430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.584430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.584789] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.585818] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.585923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.587174] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.587174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.587174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.587174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.587174] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.669078] env[69499]: INFO networking_nsxv3.common.synchronization [None req-f0ba0776-a961-4550-87bf-6c0e2389d484 None None] Enqueued Resource ID: ff78af8f-8c16-4680-ba43-c2d2a9302612 with Priority: HIGHEST for action port [ 629.669078] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff78af8f-8c16-4680-ba43-c2d2a9302612 with Priority: HIGHEST for action port [ 629.669562] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff78af8f-8c16-4680-ba43-c2d2a9302612 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.669709] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff78af8f-8c16-4680-ba43-c2d2a9302612" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.669766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff78af8f-8c16-4680-ba43-c2d2a9302612" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.669996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff78af8f-8c16-4680-ba43-c2d2a9302612" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.672018] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff78af8f-8c16-4680-ba43-c2d2a9302612',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.714337] env[69499]: INFO networking_nsxv3.common.synchronization [None req-e3bdca64-52c9-41e2-9229-3c0be23bc946 tempest-AttachVolumeTestJSON-2079313698 tempest-AttachVolumeTestJSON-2079313698-project-member] Enqueued Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGHEST for action security_group_rules [ 629.714337] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGHEST for action security_group_rules [ 629.714337] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.714337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.714337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.714337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.714589] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1159257b-8ed6-4ac4-9971-8ad543ef43f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.838034] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.883846] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.885930] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.885930] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.885930] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.886330] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.886846] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.886846] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.887193] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.887996] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.887996] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 629.887996] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.887996] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.887996] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.887996] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 629.888281] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.888281] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.910401] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.910401] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 629.910401] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.910658] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.915060] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-23069dfa-9eff-4a25-b1f0-4667a7ca488f taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.915060] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-23069dfa-9eff-4a25-b1f0-4667a7ca488f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.915060] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-23069dfa-9eff-4a25-b1f0-4667a7ca488f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.915060] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-23069dfa-9eff-4a25-b1f0-4667a7ca488f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.915060] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23069dfa-9eff-4a25-b1f0-4667a7ca488f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.003891] env[69499]: INFO networking_nsxv3.common.synchronization [None req-113293ec-ad70-47c4-89f4-476f866b61d5 tempest-AttachVolumeTestJSON-2079313698 tempest-AttachVolumeTestJSON-2079313698-project-member] Enqueued Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGHEST for action security_group_rules [ 630.004054] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGHEST for action security_group_rules [ 630.005488] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.005488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.086438] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.086565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.090052] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae with status ACTIVE [ 630.091094] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.091094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.091094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.091094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.091094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.091094] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.091094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.091451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.091451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.091451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.091748] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.091748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.091748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.091868] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.091910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.091964] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae is going to be updated. [ 630.113712] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.114680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.114680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.114680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.115050] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.115226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-820ae93c-a3f6-4d55-91b1-9fc01d1ca4ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.174023] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff78af8f-8c16-4680-ba43-c2d2a9302612 [ 630.174240] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.174403] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.174479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.175917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.175917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.175917] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff78af8f-8c16-4680-ba43-c2d2a9302612 already deleted. [ 630.175917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff78af8f-8c16-4680-ba43-c2d2a9302612" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.190871] env[69499]: INFO networking_nsxv3.common.synchronization [req-ddad0cf3-d87c-4e6d-8529-3a0e605beee5 req-b8d777f8-3e5f-464b-879b-7b7085fab5e3 tempest-SecurityGroupRulesTestJSON-1235550905 tempest-SecurityGroupRulesTestJSON-1235550905-project-member] Enqueued Resource ID: 91abdd01-517c-4bc0-a05b-4f80e2bb83ee with Priority: HIGHEST for action security_group_rules [ 630.193395] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91abdd01-517c-4bc0-a05b-4f80e2bb83ee with Priority: HIGHEST for action security_group_rules [ 630.193395] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91abdd01-517c-4bc0-a05b-4f80e2bb83ee taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.193395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91abdd01-517c-4bc0-a05b-4f80e2bb83ee" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.193395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91abdd01-517c-4bc0-a05b-4f80e2bb83ee" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.193395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91abdd01-517c-4bc0-a05b-4f80e2bb83ee" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.193395] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91abdd01-517c-4bc0-a05b-4f80e2bb83ee',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.239522] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.239522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.239522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.239522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.239522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.239522] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 already deleted. [ 630.239522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.239522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.239522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.239522] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1159257b-8ed6-4ac4-9971-8ad543ef43f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.319515] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 630.319835] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.320460] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.320729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.320973] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.321145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.321219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.322068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.322068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.322068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.322068] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.342169] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.342431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.342431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.342542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.342617] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.343283] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be created. [ 630.365963] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.367618] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.367813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.370353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.370572] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.380123] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: UNINITIALIZED for 2s [ 630.417864] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.418104] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.418240] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.418525] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.418677] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.418830] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 23069dfa-9eff-4a25-b1f0-4667a7ca488f not found, creating... [ 630.419621] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.420076] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.420174] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.420444] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.420590] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.420895] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.421071] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.421252] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.421488] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.421628] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.421771] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 23069dfa-9eff-4a25-b1f0-4667a7ca488f is going to be created. [ 630.440414] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.443019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.443019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.443019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.443019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.443019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-23069dfa-9eff-4a25-b1f0-4667a7ca488f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.716068] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.716875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.716875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.716875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.717767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.717767] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91abdd01-517c-4bc0-a05b-4f80e2bb83ee already deleted. [ 630.717767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91abdd01-517c-4bc0-a05b-4f80e2bb83ee" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.765679] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.765679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.765679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.765679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.765679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.765679] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 already deleted. [ 630.765679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.798953] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 in Status: SUCCESS [ 630.798953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.825235] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.825447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.825575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.825785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.826048] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.826048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.826530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.826530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.826530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.826530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.826898] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.826898] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.826898] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.826898] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.827185] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.827185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.827185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.827407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.827407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.827524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.827584] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.173258] env[69499]: INFO networking_nsxv3.common.synchronization [None req-4656825c-e761-4c55-b889-e533897881d3 None None] Enqueued Resource ID: 4b827d59-fb06-415b-aa7a-c09c9418dcf3 with Priority: HIGHEST for action port [ 631.173847] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b827d59-fb06-415b-aa7a-c09c9418dcf3 with Priority: HIGHEST for action port [ 631.177188] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b827d59-fb06-415b-aa7a-c09c9418dcf3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.177188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b827d59-fb06-415b-aa7a-c09c9418dcf3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.177188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b827d59-fb06-415b-aa7a-c09c9418dcf3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.177188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b827d59-fb06-415b-aa7a-c09c9418dcf3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.177188] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b827d59-fb06-415b-aa7a-c09c9418dcf3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.334074] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51d37fb6-4b72-4eba-930a-b89442ed8859: rpc.has_security_group_logging(os_id): False [ 631.351098] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.351521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.351521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.351790] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.351790] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.351967] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.352056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.352115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.352336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.352434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.353175] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.353175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.353175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.353175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.353175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.353441] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.353441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.353441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.353594] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.353681] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.353776] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be created. [ 631.406542] env[69499]: INFO networking_nsxv3.common.synchronization [req-ba335fa7-1f0b-46dc-b9b4-0011df69f0b8 req-b3087246-dadd-4b91-bd59-eb6745912630 service nova] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_rules [ 631.406716] env[69499]: INFO networking_nsxv3.common.synchronization [req-ba335fa7-1f0b-46dc-b9b4-0011df69f0b8 req-b3087246-dadd-4b91-bd59-eb6745912630 service nova] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 631.406855] env[69499]: INFO networking_nsxv3.common.synchronization [req-ba335fa7-1f0b-46dc-b9b4-0011df69f0b8 req-b3087246-dadd-4b91-bd59-eb6745912630 service nova] Enqueued Resource ID: 23069dfa-9eff-4a25-b1f0-4667a7ca488f with Priority: HIGHEST for action port [ 631.407107] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_rules [ 631.407260] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 631.407361] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23069dfa-9eff-4a25-b1f0-4667a7ca488f with Priority: HIGHEST for action port [ 631.407952] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.408031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.409563] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.409656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.409813] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-23069dfa-9eff-4a25-b1f0-4667a7ca488f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.409925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23069dfa-9eff-4a25-b1f0-4667a7ca488f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.409985] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23069dfa-9eff-4a25-b1f0-4667a7ca488f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.410197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23069dfa-9eff-4a25-b1f0-4667a7ca488f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.410279] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23069dfa-9eff-4a25-b1f0-4667a7ca488f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.411960] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.412083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.412083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.412308] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.412413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.423299] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 631.681582] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b827d59-fb06-415b-aa7a-c09c9418dcf3 [ 631.681764] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.681764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.681885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.683112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.683112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.683112] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b827d59-fb06-415b-aa7a-c09c9418dcf3 already deleted. [ 631.683112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b827d59-fb06-415b-aa7a-c09c9418dcf3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.914326] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23069dfa-9eff-4a25-b1f0-4667a7ca488f with status ACTIVE [ 631.915031] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.915031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.915031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.915031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.915374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.915374] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.915374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.915803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.915803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.915803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.915803] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.916117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.916117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.916117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.916247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.916247] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23069dfa-9eff-4a25-b1f0-4667a7ca488f is going to be updated. [ 631.936998] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.936998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.936998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.936998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.937298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.937298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23069dfa-9eff-4a25-b1f0-4667a7ca488f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.390393] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: SUCCESS [ 632.390393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.390393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.390956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.390956] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.391139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.391214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.391401] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.391497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.391579] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.894569] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.398867] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.445569] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 633.445904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.877983] env[69499]: INFO networking_nsxv3.common.synchronization [req-934fe4a2-1f3b-4c37-9fb2-f9bbb4a01060 req-9cff9ab8-3917-412c-9a60-085e2d7096d5 tempest-SecurityGroupRulesTestJSON-1235550905 tempest-SecurityGroupRulesTestJSON-1235550905-project-member] Enqueued Resource ID: e93fb74e-bcd7-4cc8-a15c-bae90ac2b693 with Priority: HIGHEST for action security_group_rules [ 633.877983] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e93fb74e-bcd7-4cc8-a15c-bae90ac2b693 with Priority: HIGHEST for action security_group_rules [ 633.878290] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e93fb74e-bcd7-4cc8-a15c-bae90ac2b693 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.878290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e93fb74e-bcd7-4cc8-a15c-bae90ac2b693" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.878290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e93fb74e-bcd7-4cc8-a15c-bae90ac2b693" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.879331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e93fb74e-bcd7-4cc8-a15c-bae90ac2b693" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.879331] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e93fb74e-bcd7-4cc8-a15c-bae90ac2b693',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.902282] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.902381] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.902422] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.902602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.903109] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.903297] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be updated. [ 633.931694] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.931694] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.931694] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.931915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.932121] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.940771] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: IN_PROGRESS for 2s [ 634.398214] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.398383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.398474] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.398671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.398761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.398860] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e93fb74e-bcd7-4cc8-a15c-bae90ac2b693 already deleted. [ 634.398945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e93fb74e-bcd7-4cc8-a15c-bae90ac2b693" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.407357] env[69499]: INFO networking_nsxv3.common.synchronization [req-95afc501-9992-4b8f-b444-113d96021ef4 req-837d2c27-a81d-4737-8fd0-408cf085c077 tempest-SecurityGroupRulesTestJSON-1235550905 tempest-SecurityGroupRulesTestJSON-1235550905-project-member] Enqueued Resource ID: 8b32a448-43e8-49cf-a571-c8a8c23e7e78 with Priority: HIGHEST for action security_group_rules [ 635.407357] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b32a448-43e8-49cf-a571-c8a8c23e7e78 with Priority: HIGHEST for action security_group_rules [ 635.407602] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.407602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.407705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.407872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.407967] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b32a448-43e8-49cf-a571-c8a8c23e7e78',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.892744] env[69499]: INFO networking_nsxv3.common.synchronization [req-9a911fae-0038-4c8c-aec2-377757f3061d req-fd38d94a-c7db-4314-83ad-1c68ef1625a5 tempest-SecurityGroupRulesTestJSON-1235550905 tempest-SecurityGroupRulesTestJSON-1235550905-project-member] Enqueued Resource ID: 8b32a448-43e8-49cf-a571-c8a8c23e7e78 with Priority: HIGHEST for action security_group_rules [ 635.893826] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b32a448-43e8-49cf-a571-c8a8c23e7e78 with Priority: HIGHEST for action security_group_rules [ 635.894573] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.894573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.939955] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.939955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.939955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.939955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.939955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.939955] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b32a448-43e8-49cf-a571-c8a8c23e7e78 already deleted. [ 635.939955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.939955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.939955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.939955] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b32a448-43e8-49cf-a571-c8a8c23e7e78',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.951993] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: SUCCESS [ 635.952318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.952584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.952892] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.953229] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.953342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.953410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.953643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.953760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.953840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.954105] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.957043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.957043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.957043] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.957043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.957043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.957043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.957043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.957043] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.458885] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.459221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.459221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.459302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.460902] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.460902] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b32a448-43e8-49cf-a571-c8a8c23e7e78 already deleted. [ 636.460902] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.460902] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.460902] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.460902] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.962926] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.222508] env[69499]: INFO networking_nsxv3.common.synchronization [req-ab4278df-682a-4c30-83d6-a7ebe63c2d6d req-3b761a49-947b-4935-b570-3c4e94e8bea7 tempest-SecurityGroupRulesTestJSON-1235550905 tempest-SecurityGroupRulesTestJSON-1235550905-project-member] Enqueued Resource ID: 8b32a448-43e8-49cf-a571-c8a8c23e7e78 with Priority: HIGHEST for action security_group_rules [ 637.222968] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b32a448-43e8-49cf-a571-c8a8c23e7e78 with Priority: HIGHEST for action security_group_rules [ 637.223480] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.223480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.223480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.223813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.223813] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b32a448-43e8-49cf-a571-c8a8c23e7e78',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.259761] env[69499]: INFO networking_nsxv3.common.synchronization [req-8c1230cf-bfc8-4a31-8c6a-c8586b2a84eb req-4e431380-4f56-419d-a55e-3fa46ece37fb tempest-ServerPasswordTestJSON-1623388183 tempest-ServerPasswordTestJSON-1623388183-project-member] Enqueued Resource ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b with Priority: HIGHEST for action security_group_members [ 637.260235] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b with Priority: HIGHEST for action security_group_members [ 637.260841] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93339c-e2b4-45e0-a4c1-b3051b85774b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.260841] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.260841] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.261052] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.261246] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.261728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.261728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.261728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.261728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.261728] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a93339c-e2b4-45e0-a4c1-b3051b85774b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.465666] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.465942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.465942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.466162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.466302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.466425] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be updated. [ 637.495565] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.495738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.495812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.496045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.496566] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.508182] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: IN_PROGRESS for 2s [ 637.529043] env[69499]: INFO networking_nsxv3.common.synchronization [req-9102f4cf-b393-4e7d-8346-bd7149647978 req-ad781e54-cfbb-4b7c-80d0-21ca5f86fb6a tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGHEST for action security_group_members [ 637.529043] env[69499]: INFO networking_nsxv3.common.synchronization [req-9102f4cf-b393-4e7d-8346-bd7149647978 req-ad781e54-cfbb-4b7c-80d0-21ca5f86fb6a tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 637.529043] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGHEST for action security_group_members [ 637.529043] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 637.529043] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.529043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.529043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.529043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.529043] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.529043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.529712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.529751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.530400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.530554] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.531475] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.531611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.531672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.531854] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.533606] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.533606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.533753] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.533926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.533987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.534062] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.734469] env[69499]: INFO networking_nsxv3.common.synchronization [req-9102f4cf-b393-4e7d-8346-bd7149647978 req-ad781e54-cfbb-4b7c-80d0-21ca5f86fb6a tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_rules [ 637.735187] env[69499]: INFO networking_nsxv3.common.synchronization [req-9102f4cf-b393-4e7d-8346-bd7149647978 req-ad781e54-cfbb-4b7c-80d0-21ca5f86fb6a tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 637.735187] env[69499]: INFO networking_nsxv3.common.synchronization [req-9102f4cf-b393-4e7d-8346-bd7149647978 req-ad781e54-cfbb-4b7c-80d0-21ca5f86fb6a tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGHEST for action security_group_rules [ 637.735187] env[69499]: INFO networking_nsxv3.common.synchronization [req-9102f4cf-b393-4e7d-8346-bd7149647978 req-ad781e54-cfbb-4b7c-80d0-21ca5f86fb6a tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGHEST for action security_group_members [ 637.735187] env[69499]: INFO networking_nsxv3.common.synchronization [req-9102f4cf-b393-4e7d-8346-bd7149647978 req-ad781e54-cfbb-4b7c-80d0-21ca5f86fb6a tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 74a5f3d6-d559-4625-80d3-fa22d7e4367c with Priority: HIGHEST for action port [ 637.736500] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_rules [ 637.736980] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGHEST for action security_group_rules [ 637.737208] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74a5f3d6-d559-4625-80d3-fa22d7e4367c with Priority: HIGHEST for action port [ 637.737283] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 637.737798] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGHEST for action security_group_members [ 637.737798] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.738136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.738136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.739051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.739051] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.740729] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.740859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.740935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.741196] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.741281] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.742103] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-74a5f3d6-d559-4625-80d3-fa22d7e4367c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.742216] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.742336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.742436] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.742504] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74a5f3d6-d559-4625-80d3-fa22d7e4367c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.743196] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.743293] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.743474] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.743551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.748158] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.748335] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.748384] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.748585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.748683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.748786] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b32a448-43e8-49cf-a571-c8a8c23e7e78 already deleted. [ 637.748874] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b32a448-43e8-49cf-a571-c8a8c23e7e78" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.765521] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.765698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.765801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.766125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.766303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.766725] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.766951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.767052] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.767291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.767382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.767479] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b already deleted. [ 637.767748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.038152] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.038923] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.108244] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-534 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.109279] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-534" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.109279] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-534" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.109279] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-534" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.109279] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.109536] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.109536] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.109627] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.110157] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.110610] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 638.111667] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.112048] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.112048] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.112048] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 638.112178] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.112867] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.136067] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.136067] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 638.136067] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.136067] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-534" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.136364] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-ed6caab2-2ac1-4094-9384-f27719229499 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.136364] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-ed6caab2-2ac1-4094-9384-f27719229499" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.136479] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-ed6caab2-2ac1-4094-9384-f27719229499" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.136788] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-ed6caab2-2ac1-4094-9384-f27719229499" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.136923] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed6caab2-2ac1-4094-9384-f27719229499',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.244594] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.244748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.244931] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74a5f3d6-d559-4625-80d3-fa22d7e4367c with status ACTIVE [ 638.245122] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.245237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.245324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.245503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.245626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.245764] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.246032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.246032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.246166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.246166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.246375] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.246475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.246522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.246672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.246744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.246831] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74a5f3d6-d559-4625-80d3-fa22d7e4367c is going to be updated. [ 638.248349] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.248464] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.271681] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.271844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.271919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.272597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.272708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.272865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.541384] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.545923] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.575945] env[69499]: INFO networking_nsxv3.common.synchronization [req-06a51625-0270-4807-bdd6-4976ed2e0f64 req-e6b84cc0-b61e-4be9-8471-f4075f4eddca tempest-ImagesTestJSON-490670806 tempest-ImagesTestJSON-490670806-project-member] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 638.575945] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 638.575945] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.575945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.576162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.578475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.579430] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.579430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.579430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.580582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.580582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.580582] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.639887] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.640134] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.640259] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.640540] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.640690] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.640845] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port ed6caab2-2ac1-4094-9384-f27719229499 not found, creating... [ 638.641116] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.641310] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.641417] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.641629] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.641794] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.642137] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.642299] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.642415] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.642625] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.642759] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.642896] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: ed6caab2-2ac1-4094-9384-f27719229499 is going to be created. [ 638.668385] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.668650] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.668796] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.669076] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.669297] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.669512] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-ed6caab2-2ac1-4094-9384-f27719229499" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.044218] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.044412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.044844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.044973] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.045073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.045224] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 is going to be created. [ 639.046664] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.046788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.046862] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.047078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.047170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.048144] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 639.074867] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.075218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.075218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.076350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.076543] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.078672] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.079225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.079225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.079225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.079225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.085164] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.085164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.085164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.085457] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.085575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.085799] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.085900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.085971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.086204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.086371] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.086449] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 639.092043] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 in Status: UNINITIALIZED for 2s [ 639.093033] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 639.152495] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.152744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.152744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.152895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.153080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.168695] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 639.180583] env[69499]: INFO networking_nsxv3.common.synchronization [req-404bf812-e2fd-48d7-964c-1b85e5a851e4 req-2f1c45fc-aeec-49ca-bb91-ddb64491525c tempest-TenantUsagesTestJSON-1286836440 tempest-TenantUsagesTestJSON-1286836440-project-member] Enqueued Resource ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 with Priority: HIGHEST for action security_group_members [ 639.181405] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 with Priority: HIGHEST for action security_group_members [ 639.181405] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.181405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.181728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.181728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.181873] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.181977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.182751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.182960] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.183094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.183238] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e367a92f-7a4f-4e34-ac00-9e0a0c97dd76',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.518457] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: SUCCESS [ 639.518676] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.518842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.519081] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.519307] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.519428] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.520876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.520876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.520876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.520876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.520876] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.520876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.520876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.520876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.520876] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.520876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.520876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.520876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.520876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.520876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.521361] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.541179] env[69499]: INFO networking_nsxv3.common.synchronization [req-77655be0-8b2e-4797-a947-e21b95ba61cb req-58b41d3e-52f7-400f-869e-c944817ced46 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: bfb7458a-4a70-45c1-acb5-648c53b6821a with Priority: HIGHEST for action security_group_members [ 639.541179] env[69499]: INFO networking_nsxv3.common.synchronization [req-77655be0-8b2e-4797-a947-e21b95ba61cb req-58b41d3e-52f7-400f-869e-c944817ced46 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 639.541179] env[69499]: INFO networking_nsxv3.common.synchronization [req-77655be0-8b2e-4797-a947-e21b95ba61cb req-58b41d3e-52f7-400f-869e-c944817ced46 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGHEST for action security_group_members [ 639.541179] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfb7458a-4a70-45c1-acb5-648c53b6821a with Priority: HIGHEST for action security_group_members [ 639.541179] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 639.541179] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGHEST for action security_group_members [ 639.541615] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfb7458a-4a70-45c1-acb5-648c53b6821a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.541918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.541918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.542061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.542217] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.542368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.542368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.542518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.542598] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.542690] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfb7458a-4a70-45c1-acb5-648c53b6821a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.543482] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.543570] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.543765] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.543836] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.671799] env[69499]: INFO networking_nsxv3.common.synchronization [req-77655be0-8b2e-4797-a947-e21b95ba61cb req-58b41d3e-52f7-400f-869e-c944817ced46 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_rules [ 639.672262] env[69499]: INFO networking_nsxv3.common.synchronization [req-77655be0-8b2e-4797-a947-e21b95ba61cb req-58b41d3e-52f7-400f-869e-c944817ced46 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 639.672262] env[69499]: INFO networking_nsxv3.common.synchronization [req-77655be0-8b2e-4797-a947-e21b95ba61cb req-58b41d3e-52f7-400f-869e-c944817ced46 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGHEST for action security_group_rules [ 639.672262] env[69499]: INFO networking_nsxv3.common.synchronization [req-77655be0-8b2e-4797-a947-e21b95ba61cb req-58b41d3e-52f7-400f-869e-c944817ced46 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGHEST for action security_group_members [ 639.672487] env[69499]: INFO networking_nsxv3.common.synchronization [req-77655be0-8b2e-4797-a947-e21b95ba61cb req-58b41d3e-52f7-400f-869e-c944817ced46 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: bfb7458a-4a70-45c1-acb5-648c53b6821a with Priority: HIGHEST for action security_group_rules [ 639.672487] env[69499]: INFO networking_nsxv3.common.synchronization [req-77655be0-8b2e-4797-a947-e21b95ba61cb req-58b41d3e-52f7-400f-869e-c944817ced46 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: bfb7458a-4a70-45c1-acb5-648c53b6821a with Priority: HIGHEST for action security_group_members [ 639.672616] env[69499]: INFO networking_nsxv3.common.synchronization [req-77655be0-8b2e-4797-a947-e21b95ba61cb req-58b41d3e-52f7-400f-869e-c944817ced46 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 74a5f3d6-d559-4625-80d3-fa22d7e4367c with Priority: HIGHEST for action port [ 639.673447] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_rules [ 639.674355] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGHEST for action security_group_rules [ 639.674355] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfb7458a-4a70-45c1-acb5-648c53b6821a with Priority: HIGHEST for action security_group_members [ 639.674355] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74a5f3d6-d559-4625-80d3-fa22d7e4367c with Priority: HIGHEST for action port [ 639.674355] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfb7458a-4a70-45c1-acb5-648c53b6821a with Priority: HIGHEST for action security_group_rules [ 639.674355] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 639.674355] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGHEST for action security_group_members [ 639.674782] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.674934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.675164] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.675254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.675433] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfb7458a-4a70-45c1-acb5-648c53b6821a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.675514] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.675687] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-74a5f3d6-d559-4625-80d3-fa22d7e4367c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.675784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.675846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.676060] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.676141] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74a5f3d6-d559-4625-80d3-fa22d7e4367c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.681665] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bfb7458a-4a70-45c1-acb5-648c53b6821a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.681665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.681665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.681665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.681665] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bfb7458a-4a70-45c1-acb5-648c53b6821a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.682617] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.682741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.682905] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.682995] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.690373] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.690503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.690562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.690799] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.690852] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.691036] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.691150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.691193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.691367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.691447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.691534] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 is going to be updated. [ 639.739409] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.739569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.739633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.739850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.739992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.750905] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 in Status: IN_PROGRESS for 2s [ 639.920414] env[69499]: INFO networking_nsxv3.common.synchronization [req-8c1230cf-bfc8-4a31-8c6a-c8586b2a84eb req-ef993333-18b2-4f71-9af7-7d902d2821ba service nova] Enqueued Resource ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b with Priority: HIGHEST for action security_group_rules [ 639.920578] env[69499]: INFO networking_nsxv3.common.synchronization [req-8c1230cf-bfc8-4a31-8c6a-c8586b2a84eb req-ef993333-18b2-4f71-9af7-7d902d2821ba service nova] Enqueued Resource ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b with Priority: HIGHEST for action security_group_members [ 639.920712] env[69499]: INFO networking_nsxv3.common.synchronization [req-8c1230cf-bfc8-4a31-8c6a-c8586b2a84eb req-ef993333-18b2-4f71-9af7-7d902d2821ba service nova] Enqueued Resource ID: ed6caab2-2ac1-4094-9384-f27719229499 with Priority: HIGHEST for action port [ 639.920949] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b with Priority: HIGHEST for action security_group_rules [ 639.921095] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b with Priority: HIGHEST for action security_group_members [ 639.921195] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed6caab2-2ac1-4094-9384-f27719229499 with Priority: HIGHEST for action port [ 639.921747] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a93339c-e2b4-45e0-a4c1-b3051b85774b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.921939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.921939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.924022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.924022] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a93339c-e2b4-45e0-a4c1-b3051b85774b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.925815] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93339c-e2b4-45e0-a4c1-b3051b85774b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.925815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.925815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.926331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.926611] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.926819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.926932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.927334] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.927334] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.927334] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a93339c-e2b4-45e0-a4c1-b3051b85774b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.928411] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed6caab2-2ac1-4094-9384-f27719229499 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.928411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed6caab2-2ac1-4094-9384-f27719229499" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.928550] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed6caab2-2ac1-4094-9384-f27719229499" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.928745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed6caab2-2ac1-4094-9384-f27719229499" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.928857] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed6caab2-2ac1-4094-9384-f27719229499',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.977558] env[69499]: INFO networking_nsxv3.common.synchronization [req-9f7575c2-b9cd-4daa-aff8-85ffc979bef0 req-bf00365d-18f8-4c2c-8386-428536bf632d tempest-ServerExternalEventsTest-1698657151 tempest-ServerExternalEventsTest-1698657151-project-member] Enqueued Resource ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 with Priority: HIGHEST for action security_group_members [ 639.978675] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 with Priority: HIGHEST for action security_group_members [ 639.978675] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdad69f2-7aae-47fc-97ab-2b17246d7e21 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.978675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.978675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.978675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.978979] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.978979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.979083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.979316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.979390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.979496] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdad69f2-7aae-47fc-97ab-2b17246d7e21',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.025387] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae: rpc.has_security_group_logging(os_id): False [ 640.045025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.045025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.045025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.045025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.045025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.045025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.045025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.045025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.045025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.045025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.045025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.045025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.045025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.045025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.045025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.045894] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.045894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.045894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.045894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.045894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.045894] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be created. [ 640.046807] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bfb7458a-4a70-45c1-acb5-648c53b6821a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.103513] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.103513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.103513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.103513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.103513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.112342] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: IN_PROGRESS for 2s [ 640.187025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfb7458a-4a70-45c1-acb5-648c53b6821a taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.187025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.187025] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74a5f3d6-d559-4625-80d3-fa22d7e4367c with status ACTIVE [ 640.187025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.187025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.187025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.187025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.187025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.187025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.187025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.187025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.187025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.187025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.187025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.187761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.187761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.187761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.187761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.187761] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74a5f3d6-d559-4625-80d3-fa22d7e4367c is going to be updated. [ 640.212021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.212021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.212021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.212021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.212021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.212021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74a5f3d6-d559-4625-80d3-fa22d7e4367c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.369605] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.369895] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.369959] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.370694] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.371108] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.371932] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.372287] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.373137] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.373137] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.373137] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 640.373137] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.374577] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.374577] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.374577] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 640.374577] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.374819] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.401602] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.402256] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 640.403276] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.403622] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.403955] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-e5036219-7b8b-4180-8427-78e715cf6148 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.404159] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-e5036219-7b8b-4180-8427-78e715cf6148" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.404376] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-e5036219-7b8b-4180-8427-78e715cf6148" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.404730] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-e5036219-7b8b-4180-8427-78e715cf6148" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.404885] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5036219-7b8b-4180-8427-78e715cf6148',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.434562] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93339c-e2b4-45e0-a4c1-b3051b85774b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.434696] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.434881] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a93339c-e2b4-45e0-a4c1-b3051b85774b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.435744] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed6caab2-2ac1-4094-9384-f27719229499 with status ACTIVE [ 640.435871] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.436495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.436495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.436495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.436657] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.436828] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.436975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.437094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.437295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.437424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.437661] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.438018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.438018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.438210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.438252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.438399] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed6caab2-2ac1-4094-9384-f27719229499 is going to be updated. [ 640.461476] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.461732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.461863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.462127] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.462315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.462498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed6caab2-2ac1-4094-9384-f27719229499" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.482707] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.482932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.483050] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.483324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.484114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.484340] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.484450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.484518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.484727] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.484822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.484939] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 already deleted. [ 640.485106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.551079] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bfb7458a-4a70-45c1-acb5-648c53b6821a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.638388] env[69499]: INFO networking_nsxv3.common.synchronization [None req-7d8b4129-226a-4e64-8d6e-eadfebb627f7 None None] Enqueued Resource ID: 77989268-ce74-41dd-bcd3-926f3314ee86 with Priority: HIGHEST for action port [ 640.638388] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77989268-ce74-41dd-bcd3-926f3314ee86 with Priority: HIGHEST for action port [ 640.638388] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-77989268-ce74-41dd-bcd3-926f3314ee86 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.638388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77989268-ce74-41dd-bcd3-926f3314ee86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.639224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77989268-ce74-41dd-bcd3-926f3314ee86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.639603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77989268-ce74-41dd-bcd3-926f3314ee86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.639820] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77989268-ce74-41dd-bcd3-926f3314ee86',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.909569] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.909762] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.909893] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.910195] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.910387] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.910577] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port e5036219-7b8b-4180-8427-78e715cf6148 not found, creating... [ 640.910769] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.910925] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.911026] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.911263] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.911443] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.911740] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.911920] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.912241] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.912731] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.912731] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.912731] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: e5036219-7b8b-4180-8427-78e715cf6148 is going to be created. [ 640.932154] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.932917] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.932917] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.932917] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.932917] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.933198] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-e5036219-7b8b-4180-8427-78e715cf6148" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.941726] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a93339c-e2b4-45e0-a4c1-b3051b85774b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.054375] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.055228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.055717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.056471] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.057180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.057330] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfb7458a-4a70-45c1-acb5-648c53b6821a is going to be created. [ 641.087784] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.089122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.089122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.089242] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.090962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.111526] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 in Status: SUCCESS [ 641.111771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.111937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.112184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.112419] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.112509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.112550] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.112784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.112784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.112904] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.114536] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfb7458a-4a70-45c1-acb5-648c53b6821a in Status: UNINITIALIZED for 2s [ 641.120351] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 641.120351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.120351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.120351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.120351] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.120351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.120351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.120351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.120351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.120351] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.141786] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77989268-ce74-41dd-bcd3-926f3314ee86 [ 641.141786] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.141786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.141786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.141992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.142101] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.142189] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77989268-ce74-41dd-bcd3-926f3314ee86 already deleted. [ 641.142991] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77989268-ce74-41dd-bcd3-926f3314ee86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.184282] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 641.184282] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de deletion is rescheduled due to dependency. [ 641.184282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.445569] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.445759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.445845] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.446103] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.446205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.446319] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b is going to be created. [ 641.468592] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.468678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.468751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.468962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.469125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.497420] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b in Status: UNINITIALIZED for 2s [ 641.618890] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.621301] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.773172] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 in Status: SUCCESS [ 641.773172] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 deletion is rescheduled due to dependency. [ 641.773172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.022241] env[69499]: INFO networking_nsxv3.common.synchronization [req-9f7575c2-b9cd-4daa-aff8-85ffc979bef0 req-80d385bc-054a-40a9-8758-61b004d8af01 service nova] Enqueued Resource ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 with Priority: HIGHEST for action security_group_rules [ 642.022241] env[69499]: INFO networking_nsxv3.common.synchronization [req-9f7575c2-b9cd-4daa-aff8-85ffc979bef0 req-80d385bc-054a-40a9-8758-61b004d8af01 service nova] Enqueued Resource ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 with Priority: HIGHEST for action security_group_members [ 642.022241] env[69499]: INFO networking_nsxv3.common.synchronization [req-9f7575c2-b9cd-4daa-aff8-85ffc979bef0 req-80d385bc-054a-40a9-8758-61b004d8af01 service nova] Enqueued Resource ID: e5036219-7b8b-4180-8427-78e715cf6148 with Priority: HIGHEST for action port [ 642.022241] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 with Priority: HIGHEST for action security_group_rules [ 642.022398] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 with Priority: HIGHEST for action security_group_members [ 642.022654] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5036219-7b8b-4180-8427-78e715cf6148 with Priority: HIGHEST for action port [ 642.022854] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdad69f2-7aae-47fc-97ab-2b17246d7e21 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.023024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.023120] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.025039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.025039] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdad69f2-7aae-47fc-97ab-2b17246d7e21',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.025039] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdad69f2-7aae-47fc-97ab-2b17246d7e21 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.026244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.026457] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.026972] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.027069] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.027173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.027275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.027499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.027635] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.027873] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdad69f2-7aae-47fc-97ab-2b17246d7e21',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.028843] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5036219-7b8b-4180-8427-78e715cf6148 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.029069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5036219-7b8b-4180-8427-78e715cf6148" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.029726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5036219-7b8b-4180-8427-78e715cf6148" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.030624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5036219-7b8b-4180-8427-78e715cf6148" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.030624] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5036219-7b8b-4180-8427-78e715cf6148',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.122249] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.127510] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: SUCCESS [ 642.127907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.128301] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.129132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.132094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.132094] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.285012] env[69499]: INFO networking_nsxv3.common.synchronization [req-e997d48f-e713-4f5c-80a8-328c825bd98d req-f6938952-5665-4534-9088-40ff0747d487 tempest-ImagesOneServerTestJSON-342013829 tempest-ImagesOneServerTestJSON-342013829-project-member] Enqueued Resource ID: f140365e-2848-4938-ba34-06e4b21ec256 with Priority: HIGHEST for action security_group_members [ 642.285685] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f140365e-2848-4938-ba34-06e4b21ec256 with Priority: HIGHEST for action security_group_members [ 642.288275] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f140365e-2848-4938-ba34-06e4b21ec256 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.288522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.288710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.288894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.289099] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.289221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.289292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.289422] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.289510] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.289607] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f140365e-2848-4938-ba34-06e4b21ec256',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.383784] env[69499]: INFO networking_nsxv3.common.synchronization [None req-885543ab-f7e8-4d4b-a3fb-40846555cb7f None None] Enqueued Resource ID: 3ec60b96-53db-4cbd-9d1e-375d6722b618 with Priority: HIGHEST for action port [ 642.383784] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ec60b96-53db-4cbd-9d1e-375d6722b618 with Priority: HIGHEST for action port [ 642.383784] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ec60b96-53db-4cbd-9d1e-375d6722b618 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.384347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ec60b96-53db-4cbd-9d1e-375d6722b618" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.384654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ec60b96-53db-4cbd-9d1e-375d6722b618" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.385662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ec60b96-53db-4cbd-9d1e-375d6722b618" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.385662] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ec60b96-53db-4cbd-9d1e-375d6722b618',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.532849] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdad69f2-7aae-47fc-97ab-2b17246d7e21',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.533796] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdad69f2-7aae-47fc-97ab-2b17246d7e21 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.533922] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.534312] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5036219-7b8b-4180-8427-78e715cf6148 with status ACTIVE [ 642.534525] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.534603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.534642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.534877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.534966] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.535149] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.535258] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.535310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.535471] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.537020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.537327] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.537439] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.537507] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.537700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.537768] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.537866] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5036219-7b8b-4180-8427-78e715cf6148 is going to be updated. [ 642.560764] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.560897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.561075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.561390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.561451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.561880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5036219-7b8b-4180-8427-78e715cf6148" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.629170] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.629495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.629495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.629711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.629785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.629868] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 is going to be updated. [ 642.633855] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.633995] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.634066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.634312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.634418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.634518] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 642.637496] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.637625] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.637713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.638468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.638468] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.638468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.638468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.638769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.638769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.638843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.638878] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.682833] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.683182] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.683279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.683499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.683715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.686691] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.687241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.687521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.687766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.690397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.709557] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 642.709557] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 in Status: IN_PROGRESS for 2s [ 642.792358] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.792504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.792504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.793030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.793030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.793030] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.793211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.793211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.793285] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.793566] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.793706] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f140365e-2848-4938-ba34-06e4b21ec256 already deleted. [ 642.793823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.795940] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-637 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.796511] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-637" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.796511] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-637" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.796746] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-637" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.798557] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.798557] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.798752] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.798931] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.799701] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.799701] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 642.799701] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.800030] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.800327] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.801177] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 642.801177] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.801359] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.822236] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.822448] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 642.822621] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.822816] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-637" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.823221] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-48a9e880-3a19-44b0-a445-477e70430ce3 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.823459] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-48a9e880-3a19-44b0-a445-477e70430ce3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.823586] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-48a9e880-3a19-44b0-a445-477e70430ce3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.823951] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-48a9e880-3a19-44b0-a445-477e70430ce3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.828027] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48a9e880-3a19-44b0-a445-477e70430ce3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.888247] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ec60b96-53db-4cbd-9d1e-375d6722b618 [ 642.888412] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.888532] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.888607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.888910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.889135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.889189] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ec60b96-53db-4cbd-9d1e-375d6722b618 already deleted. [ 642.889248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ec60b96-53db-4cbd-9d1e-375d6722b618" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.036266] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdad69f2-7aae-47fc-97ab-2b17246d7e21',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.120739] env[69499]: INFO networking_nsxv3.common.synchronization [None req-6f0cc49c-ff91-4d43-8a07-64973d792c48 None None] Enqueued Resource ID: 7d4f23ae-ca80-43fd-abb8-84d88e416dbf with Priority: HIGHEST for action port [ 643.120739] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d4f23ae-ca80-43fd-abb8-84d88e416dbf with Priority: HIGHEST for action port [ 643.120739] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d4f23ae-ca80-43fd-abb8-84d88e416dbf taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.120739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d4f23ae-ca80-43fd-abb8-84d88e416dbf" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.120739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d4f23ae-ca80-43fd-abb8-84d88e416dbf" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.121183] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d4f23ae-ca80-43fd-abb8-84d88e416dbf" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.121183] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d4f23ae-ca80-43fd-abb8-84d88e416dbf',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.132713] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfb7458a-4a70-45c1-acb5-648c53b6821a in Status: SUCCESS [ 643.133214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.133929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.134170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.134374] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.134532] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.134569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.134726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.134807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.134900] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfb7458a-4a70-45c1-acb5-648c53b6821a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.142607] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.142803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.142880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.143170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.143317] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.144524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.144524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.144524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.144524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.144524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.144524] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.144524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.144524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.144524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.144524] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.144524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.144524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.144982] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.144982] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.144982] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.144982] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.333294] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.333294] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.333294] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.333294] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.333294] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.333294] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 48a9e880-3a19-44b0-a445-477e70430ce3 not found, creating... [ 643.333294] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.333294] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.333294] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.333294] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.333294] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.333740] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.333740] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.333922] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.334286] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.334573] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.334828] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 48a9e880-3a19-44b0-a445-477e70430ce3 is going to be created. [ 643.358614] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.358614] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.358614] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.358614] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.358614] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.359574] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-48a9e880-3a19-44b0-a445-477e70430ce3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.421808] env[69499]: INFO networking_nsxv3.common.synchronization [None req-7b56ce75-a8cf-4119-89b4-9049a7d4348a tempest-AttachVolumeShelveTestJSON-1831532901 tempest-AttachVolumeShelveTestJSON-1831532901-project-member] Enqueued Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_rules [ 643.422591] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_rules [ 643.422945] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8593ab1f-869e-4abc-aa58-bb57de585b7e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.423143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.423208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.423420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.423506] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.517089] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b in Status: SUCCESS [ 643.517089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.517089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.517089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.517089] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.517089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.517089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.517089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.517533] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.517533] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.517533] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a93339c-e2b4-45e0-a4c1-b3051b85774b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.541413] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.541655] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.541655] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.545133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.545862] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.545862] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 is going to be created. [ 643.552478] env[69499]: INFO networking_nsxv3.common.synchronization [None req-00702112-f4ae-4f10-b5ef-e1d41bb6ba03 tempest-AttachVolumeShelveTestJSON-1831532901 tempest-AttachVolumeShelveTestJSON-1831532901-project-member] Enqueued Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_rules [ 643.553905] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_rules [ 643.561960] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8593ab1f-869e-4abc-aa58-bb57de585b7e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.562128] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.587514] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.587739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.587739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.588850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.588850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.600290] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 in Status: UNINITIALIZED for 2s [ 643.627019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d4f23ae-ca80-43fd-abb8-84d88e416dbf [ 643.627520] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.627520] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.627520] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.627755] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.627804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.627862] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d4f23ae-ca80-43fd-abb8-84d88e416dbf already deleted. [ 643.627947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d4f23ae-ca80-43fd-abb8-84d88e416dbf" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.639024] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bfb7458a-4a70-45c1-acb5-648c53b6821a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.649799] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae: rpc.has_security_group_logging(os_id): False [ 643.675422] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.675648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.675730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.676602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.676738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.677034] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.677182] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.677274] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.680912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.680912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.680912] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.680912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.680912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.680912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.680912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.680912] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.680912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.680912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.680912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.680912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.680912] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be updated. [ 643.742596] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.742752] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.742798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.742987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.743142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.768720] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: IN_PROGRESS for 2s [ 643.943586] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.945940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.945940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.945940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.945940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.945940] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e already deleted. [ 643.945940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.945940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.945940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.945940] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.022154] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93339c-e2b4-45e0-a4c1-b3051b85774b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.022315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.022315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.022661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.022736] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.023125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.023125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.023125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.023125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.023332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.023372] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93339c-e2b4-45e0-a4c1-b3051b85774b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.023443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.023503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.023652] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.023788] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.023896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.023959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.024180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.024243] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.024281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.024395] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a93339c-e2b4-45e0-a4c1-b3051b85774b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.143439] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bfb7458a-4a70-45c1-acb5-648c53b6821a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.349275] env[69499]: INFO networking_nsxv3.common.synchronization [None req-a1eecb2b-74ca-4174-bc0e-6ec02242447d None None] Enqueued Resource ID: 1c1a58be-c472-49b2-b57a-2e97f010a71c with Priority: HIGHEST for action port [ 644.349275] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c1a58be-c472-49b2-b57a-2e97f010a71c with Priority: HIGHEST for action port [ 644.349275] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c1a58be-c472-49b2-b57a-2e97f010a71c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.349275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c1a58be-c472-49b2-b57a-2e97f010a71c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.349275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c1a58be-c472-49b2-b57a-2e97f010a71c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.349506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c1a58be-c472-49b2-b57a-2e97f010a71c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.349619] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c1a58be-c472-49b2-b57a-2e97f010a71c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.467995] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.468133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.468195] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.468371] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.468455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.468548] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e already deleted. [ 644.468626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.509821] env[69499]: INFO networking_nsxv3.common.synchronization [req-d9d550de-ee82-48dd-a73d-3b3c5bc18711 req-ed826a93-1de5-448f-b489-ac52af94e7b3 tempest-MultipleCreateTestJSON-19272315 tempest-MultipleCreateTestJSON-19272315-project-member] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 644.510261] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 644.511019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.511198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.511281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.511490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.511841] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.511960] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.512038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.512212] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.512302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.512401] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.527118] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a93339c-e2b4-45e0-a4c1-b3051b85774b: rpc.has_security_group_logging(os_id): False [ 644.544804] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.544990] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.545079] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.545275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.545374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.545691] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.545691] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.546009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.546009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.546009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.546255] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.546255] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.546364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.546661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.546661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.546768] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.546819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.546855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.547092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.547092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.547255] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b is going to be created. [ 644.603121] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.603420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.603420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.603724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.603781] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.617712] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b in Status: IN_PROGRESS for 2s [ 644.649025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.649025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.649025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.649025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.649025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.649025] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfb7458a-4a70-45c1-acb5-648c53b6821a is going to be updated. [ 644.699382] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.700358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.700482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.700772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.700926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.711908] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfb7458a-4a70-45c1-acb5-648c53b6821a in Status: IN_PROGRESS for 2s [ 644.721413] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 644.722043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.722156] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.722370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.722563] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.722673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.722725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.723214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.723214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.723214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.723214] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.726971] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 in Status: SUCCESS [ 644.727184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.727357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.727542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.727719] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.727838] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.728046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.728116] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.728365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.728365] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.729054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.730251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.730251] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.730251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.730251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.730450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.730450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.730516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.730600] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.733512] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.733682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.733966] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.733966] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.734160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.734160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.734235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.734357] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.737082] env[69499]: INFO networking_nsxv3.common.synchronization [req-e997d48f-e713-4f5c-80a8-328c825bd98d req-0177757f-7f34-4d1c-984a-b55fa0bbfcaa service nova] Enqueued Resource ID: f140365e-2848-4938-ba34-06e4b21ec256 with Priority: HIGHEST for action security_group_rules [ 644.737816] env[69499]: INFO networking_nsxv3.common.synchronization [req-e997d48f-e713-4f5c-80a8-328c825bd98d req-0177757f-7f34-4d1c-984a-b55fa0bbfcaa service nova] Enqueued Resource ID: f140365e-2848-4938-ba34-06e4b21ec256 with Priority: HIGHEST for action security_group_members [ 644.738073] env[69499]: INFO networking_nsxv3.common.synchronization [req-e997d48f-e713-4f5c-80a8-328c825bd98d req-0177757f-7f34-4d1c-984a-b55fa0bbfcaa service nova] Enqueued Resource ID: 48a9e880-3a19-44b0-a445-477e70430ce3 with Priority: HIGHEST for action port [ 644.739102] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f140365e-2848-4938-ba34-06e4b21ec256 with Priority: HIGHEST for action security_group_rules [ 644.739351] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f140365e-2848-4938-ba34-06e4b21ec256 with Priority: HIGHEST for action security_group_members [ 644.741208] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48a9e880-3a19-44b0-a445-477e70430ce3 with Priority: HIGHEST for action port [ 644.741208] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f140365e-2848-4938-ba34-06e4b21ec256 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.741208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.741208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.741208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.741208] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f140365e-2848-4938-ba34-06e4b21ec256',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.742253] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f140365e-2848-4938-ba34-06e4b21ec256 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.742253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.742253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.742437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.742509] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.742595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.742659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.742807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.742875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.742982] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f140365e-2848-4938-ba34-06e4b21ec256',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.743682] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-48a9e880-3a19-44b0-a445-477e70430ce3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.743793] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48a9e880-3a19-44b0-a445-477e70430ce3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.743853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48a9e880-3a19-44b0-a445-477e70430ce3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.744018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48a9e880-3a19-44b0-a445-477e70430ce3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.744101] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48a9e880-3a19-44b0-a445-477e70430ce3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.854878] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c1a58be-c472-49b2-b57a-2e97f010a71c [ 644.855281] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.855386] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.855568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.855749] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.855847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.855945] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c1a58be-c472-49b2-b57a-2e97f010a71c already deleted. [ 644.856069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c1a58be-c472-49b2-b57a-2e97f010a71c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.015247] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.051237] env[69499]: INFO networking_nsxv3.common.synchronization [req-0f4d9173-91f8-4ec3-bb14-52e63ca4813a req-39b86f97-cf9c-4d04-a647-4ed7631491d7 tempest-MultipleCreateTestJSON-19272315 tempest-MultipleCreateTestJSON-19272315-project-member] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 645.051938] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 645.053046] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.053046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.191863] env[69499]: INFO networking_nsxv3.common.synchronization [None req-bac20547-3be4-48e7-b2d6-72368d45a765 tempest-ServersTestFqdnHostnames-969656061 tempest-ServersTestFqdnHostnames-969656061-project-member] Enqueued Resource ID: a240c519-0037-4bca-bd0c-b35068bcd700 with Priority: HIGHEST for action security_group_rules [ 645.192467] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a240c519-0037-4bca-bd0c-b35068bcd700 with Priority: HIGHEST for action security_group_rules [ 645.192798] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a240c519-0037-4bca-bd0c-b35068bcd700 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.192945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.193243] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.193584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.193720] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a240c519-0037-4bca-bd0c-b35068bcd700',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.234037] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.234037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.234037] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.239332] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.240176] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.242314] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f140365e-2848-4938-ba34-06e4b21ec256 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.243268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.246867] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f140365e-2848-4938-ba34-06e4b21ec256',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.247643] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48a9e880-3a19-44b0-a445-477e70430ce3 with status ACTIVE [ 645.247874] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.247996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.248094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.248287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.248397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.248697] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.248833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.248904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.249091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.249254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.249362] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.249468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.249692] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.249692] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.249863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.249954] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48a9e880-3a19-44b0-a445-477e70430ce3 is going to be updated. [ 645.274892] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.275022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.275067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.275286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.275429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.275602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48a9e880-3a19-44b0-a445-477e70430ce3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.295506] env[69499]: INFO networking_nsxv3.common.synchronization [None req-291bd04b-a85a-41e3-b4bb-402b6ea45661 tempest-ServersTestFqdnHostnames-969656061 tempest-ServersTestFqdnHostnames-969656061-project-member] Enqueued Resource ID: a240c519-0037-4bca-bd0c-b35068bcd700 with Priority: HIGHEST for action security_group_rules [ 645.296643] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a240c519-0037-4bca-bd0c-b35068bcd700 with Priority: HIGHEST for action security_group_rules [ 645.299331] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a240c519-0037-4bca-bd0c-b35068bcd700 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.299473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.524511] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.611026] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 in Status: SUCCESS [ 645.611026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.611026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.611026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.611026] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.611026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.611026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.611026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.611026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.615274] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.615274] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdad69f2-7aae-47fc-97ab-2b17246d7e21',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.718381] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.718766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.718766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.718983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.720870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.720870] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a240c519-0037-4bca-bd0c-b35068bcd700 already deleted. [ 645.720870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.720870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.720870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.720870] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a240c519-0037-4bca-bd0c-b35068bcd700',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.737674] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.741659] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.742495] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aebfc4ad-c9f8-4810-8396-c3dbd5247dc8: rpc.has_security_group_logging(os_id): False [ 645.751949] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f140365e-2848-4938-ba34-06e4b21ec256',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.759982] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.760242] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.760388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.760831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.760831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.761334] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.761334] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.761641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.761641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.761734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.761767] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 is going to be created. [ 645.780364] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: SUCCESS [ 645.780628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.814409] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.814534] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.814738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.815441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.815668] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.826760] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 in Status: IN_PROGRESS for 2s [ 645.987899] env[69499]: INFO networking_nsxv3.common.synchronization [None req-00f52a42-7a46-464b-b0c2-1a136205e6e4 None None] Enqueued Resource ID: 58c40304-b144-4018-a0e5-f5569bc54059 with Priority: HIGHEST for action port [ 645.988466] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58c40304-b144-4018-a0e5-f5569bc54059 with Priority: HIGHEST for action port [ 645.988875] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-58c40304-b144-4018-a0e5-f5569bc54059 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.989085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58c40304-b144-4018-a0e5-f5569bc54059" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.989274] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58c40304-b144-4018-a0e5-f5569bc54059" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.989688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58c40304-b144-4018-a0e5-f5569bc54059" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.989688] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58c40304-b144-4018-a0e5-f5569bc54059',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.027526] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.027690] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.027762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.027984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.028076] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.028178] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be updated. [ 646.062045] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.062298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.062421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.062876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.062965] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.075158] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: IN_PROGRESS for 2s [ 646.117734] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdad69f2-7aae-47fc-97ab-2b17246d7e21 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.118875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.118987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.119279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.119604] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.119740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.119812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.120017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.120115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.120280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.120379] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdad69f2-7aae-47fc-97ab-2b17246d7e21 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.120475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.120539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.120697] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.120847] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.120940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.121011] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.122450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.122560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.122671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.122785] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdad69f2-7aae-47fc-97ab-2b17246d7e21',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.241364] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.241364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.241364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.241364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.241364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.241364] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 646.246719] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.246719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.246719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.246719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.246719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.246719] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 is going to be updated. [ 646.254867] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.255432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.255558] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.256247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.256247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.256247] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f140365e-2848-4938-ba34-06e4b21ec256 is going to be created. [ 646.259309] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.259427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.259491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.261994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.261994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.261994] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a240c519-0037-4bca-bd0c-b35068bcd700 already deleted. [ 646.261994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.286560] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.286961] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.286961] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.288659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.288872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.290846] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.291157] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.291157] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.291367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.291531] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.300836] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.300986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.301108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.301305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.301545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.304319] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 in Status: IN_PROGRESS for 2s [ 646.307064] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 646.311429] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f140365e-2848-4938-ba34-06e4b21ec256 in Status: UNINITIALIZED for 2s [ 646.496818] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58c40304-b144-4018-a0e5-f5569bc54059 [ 646.497366] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.497893] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.497893] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.497893] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.498146] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.498146] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58c40304-b144-4018-a0e5-f5569bc54059 already deleted. [ 646.498146] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58c40304-b144-4018-a0e5-f5569bc54059" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.626049] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdad69f2-7aae-47fc-97ab-2b17246d7e21: rpc.has_security_group_logging(os_id): False [ 646.632054] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b in Status: SUCCESS [ 646.632054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.651290] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.651290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.651290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.651290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.651290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.651290] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.651290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.651290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.651290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.651290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.651290] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.651290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.651290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.651290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.652508] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.652837] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.653133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.653307] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.653547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.653726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.653911] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 is going to be created. [ 646.713265] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.713440] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.713482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.714800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.714800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.727659] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfb7458a-4a70-45c1-acb5-648c53b6821a in Status: SUCCESS [ 646.727659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.727659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.727659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.727659] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.727659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.727659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.727659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.727659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.727659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.727659] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bfb7458a-4a70-45c1-acb5-648c53b6821a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.729634] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 in Status: IN_PROGRESS for 2s [ 647.233432] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bfb7458a-4a70-45c1-acb5-648c53b6821a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.735213] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bfb7458a-4a70-45c1-acb5-648c53b6821a: rpc.has_security_group_logging(os_id): False [ 647.752189] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.752280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.752362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.754122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.754122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.754122] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.754122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.754122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.754122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.754122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.754122] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bfb7458a-4a70-45c1-acb5-648c53b6821a is going to be created. [ 647.813606] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.813844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.813916] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.814328] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.816517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.830154] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bfb7458a-4a70-45c1-acb5-648c53b6821a in Status: IN_PROGRESS for 2s [ 647.841723] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 in Status: SUCCESS [ 647.842201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.842735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.843019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.843148] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.085721] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: SUCCESS [ 648.085721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.085721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.085721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.085721] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.085721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.085721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.085721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.085721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.085721] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.246612] env[69499]: INFO networking_nsxv3.common.synchronization [req-7e64b806-9d47-45bc-b9b2-57c92c28ab95 req-8a4f206d-9deb-4352-b6ee-c60ecdf8577d tempest-FloatingIPsAssociationNegativeTestJSON-1740764247 tempest-FloatingIPsAssociationNegativeTestJSON-1740764247-project-member] Enqueued Resource ID: b2889969-ebaf-471e-b592-cc2c82c2f544 with Priority: HIGHEST for action security_group_members [ 648.247222] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2889969-ebaf-471e-b592-cc2c82c2f544 with Priority: HIGHEST for action security_group_members [ 648.247593] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2889969-ebaf-471e-b592-cc2c82c2f544 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.247731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.247792] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.248114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.248276] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.248449] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.248449] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.248602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.248691] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.248791] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2889969-ebaf-471e-b592-cc2c82c2f544',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.316023] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 648.316023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.316291] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 in Status: SUCCESS [ 648.317385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.317385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.317385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.317385] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.317385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.317385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.318246] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.318515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.318947] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.322028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.322028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.322028] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.322028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.322028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.322028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.323024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.323237] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.330201] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f140365e-2848-4938-ba34-06e4b21ec256 in Status: SUCCESS [ 648.330540] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.331729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.334035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.334035] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.334035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.334035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.334035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.334035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.334035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.334035] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f140365e-2848-4938-ba34-06e4b21ec256',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.345252] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.345402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.588496] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.588980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.589096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.589370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.589496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.589754] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.589929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.590037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.590253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.590351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.590450] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be updated. [ 648.616552] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.616552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.616552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.616863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.616863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.625375] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: IN_PROGRESS for 2s [ 648.743292] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 in Status: SUCCESS [ 648.747867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.753522] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.753833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.753999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.754513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.754963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.755458] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.755853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.756080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.756617] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.756799] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.756982] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2889969-ebaf-471e-b592-cc2c82c2f544 already deleted. [ 648.757176] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.825946] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.828072] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.840230] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f140365e-2848-4938-ba34-06e4b21ec256 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.840230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.840230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.840230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.840230] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.840230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.840230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.840230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.840230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.840230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.840230] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f140365e-2848-4938-ba34-06e4b21ec256 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.840230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.840230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.840230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.840230] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.840230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.840896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.840896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.840896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.840896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.840896] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f140365e-2848-4938-ba34-06e4b21ec256',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.150967] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-696 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.151085] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-696" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.151152] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-696" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.151560] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-696" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.151834] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.151995] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.152167] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.152902] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.152902] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.152991] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.153086] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.153197] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.153476] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.153637] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.153748] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.153881] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.175869] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.175869] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 649.175869] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.175869] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-696" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.176368] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-8dec9e7e-dc37-4797-873c-10ec2ee64c44 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.176368] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-8dec9e7e-dc37-4797-873c-10ec2ee64c44" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.176368] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-8dec9e7e-dc37-4797-873c-10ec2ee64c44" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.176643] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-8dec9e7e-dc37-4797-873c-10ec2ee64c44" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.176770] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dec9e7e-dc37-4797-873c-10ec2ee64c44',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.301369] env[69499]: INFO networking_nsxv3.common.synchronization [None req-c696c5f4-cf0e-4171-9960-8cf7bb8c4084 None None] Enqueued Resource ID: 51b6612a-9a29-40a8-8acb-4bad790d17d6 with Priority: HIGHEST for action port [ 649.301639] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51b6612a-9a29-40a8-8acb-4bad790d17d6 with Priority: HIGHEST for action port [ 649.302259] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-51b6612a-9a29-40a8-8acb-4bad790d17d6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.302387] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51b6612a-9a29-40a8-8acb-4bad790d17d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.302455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51b6612a-9a29-40a8-8acb-4bad790d17d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.302753] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51b6612a-9a29-40a8-8acb-4bad790d17d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.302822] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51b6612a-9a29-40a8-8acb-4bad790d17d6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.328347] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.333490] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.346022] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f140365e-2848-4938-ba34-06e4b21ec256: rpc.has_security_group_logging(os_id): False [ 649.361488] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.361895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.361895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.362061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.362061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.362376] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.362522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.362522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.362638] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.362726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.362934] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.363042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.363102] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.363250] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.363325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.363677] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.363677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.363677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.363899] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.363899] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.364010] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f140365e-2848-4938-ba34-06e4b21ec256 is going to be created. [ 649.414994] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.415239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.415343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.415673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.415948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.426961] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f140365e-2848-4938-ba34-06e4b21ec256 in Status: IN_PROGRESS for 2s [ 649.680935] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.680935] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.680935] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.680935] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.680935] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.680935] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 8dec9e7e-dc37-4797-873c-10ec2ee64c44 not found, creating... [ 649.681323] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.681323] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.681323] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.682074] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.682074] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.682074] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.683259] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.683472] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.683614] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.683749] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.683916] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 8dec9e7e-dc37-4797-873c-10ec2ee64c44 is going to be created. [ 649.704118] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.704607] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.704607] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.704832] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.706338] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.706338] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-8dec9e7e-dc37-4797-873c-10ec2ee64c44" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.809042] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51b6612a-9a29-40a8-8acb-4bad790d17d6 [ 649.809042] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.809042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.809042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.809042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.809042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.809042] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51b6612a-9a29-40a8-8acb-4bad790d17d6 already deleted. [ 649.809042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51b6612a-9a29-40a8-8acb-4bad790d17d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.831195] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.831444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.831556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.831784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.831871] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.831971] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 649.838086] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.838252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.838296] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.838479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.838562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.838669] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 is going to be updated. [ 649.851512] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bfb7458a-4a70-45c1-acb5-648c53b6821a in Status: SUCCESS [ 649.851791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.877445] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.877445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.877589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.881407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.881407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.881407] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.881407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.881407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.881407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.881768] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.894131] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 649.894472] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 in Status: IN_PROGRESS for 2s [ 650.634766] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: SUCCESS [ 650.635758] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae deletion is rescheduled due to dependency. [ 650.635955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.719548] env[69499]: INFO networking_nsxv3.common.synchronization [req-7e64b806-9d47-45bc-b9b2-57c92c28ab95 req-21f1db7f-18c6-44a9-931d-4dc69d549f93 service nova] Enqueued Resource ID: b2889969-ebaf-471e-b592-cc2c82c2f544 with Priority: HIGHEST for action security_group_rules [ 650.719725] env[69499]: INFO networking_nsxv3.common.synchronization [req-7e64b806-9d47-45bc-b9b2-57c92c28ab95 req-21f1db7f-18c6-44a9-931d-4dc69d549f93 service nova] Enqueued Resource ID: b2889969-ebaf-471e-b592-cc2c82c2f544 with Priority: HIGHEST for action security_group_members [ 650.720916] env[69499]: INFO networking_nsxv3.common.synchronization [req-7e64b806-9d47-45bc-b9b2-57c92c28ab95 req-21f1db7f-18c6-44a9-931d-4dc69d549f93 service nova] Enqueued Resource ID: 8dec9e7e-dc37-4797-873c-10ec2ee64c44 with Priority: HIGHEST for action port [ 650.720916] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2889969-ebaf-471e-b592-cc2c82c2f544 with Priority: HIGHEST for action security_group_rules [ 650.720916] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2889969-ebaf-471e-b592-cc2c82c2f544 with Priority: HIGHEST for action security_group_members [ 650.720916] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dec9e7e-dc37-4797-873c-10ec2ee64c44 with Priority: HIGHEST for action port [ 650.721152] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2889969-ebaf-471e-b592-cc2c82c2f544 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.724706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.724706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.724706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.724706] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2889969-ebaf-471e-b592-cc2c82c2f544',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.725343] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2889969-ebaf-471e-b592-cc2c82c2f544 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.725444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.725521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.725754] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.725955] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.726042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.726109] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.726261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.726349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.726558] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2889969-ebaf-471e-b592-cc2c82c2f544',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.729325] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dec9e7e-dc37-4797-873c-10ec2ee64c44 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.729325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dec9e7e-dc37-4797-873c-10ec2ee64c44" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.729325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dec9e7e-dc37-4797-873c-10ec2ee64c44" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.729623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dec9e7e-dc37-4797-873c-10ec2ee64c44" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.729623] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dec9e7e-dc37-4797-873c-10ec2ee64c44',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.734066] env[69499]: INFO networking_nsxv3.common.synchronization [req-8912fb74-cf1a-499d-bacb-0de3391ad575 req-2a119830-b40e-48ed-981e-4fe918ae6057 tempest-FloatingIPsAssociationTestJSON-1168940114 tempest-FloatingIPsAssociationTestJSON-1168940114-project-member] Enqueued Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_members [ 650.734344] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_members [ 650.734610] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-04847a44-8459-4dcc-b6cd-80a364fba3d0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.734695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.734795] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.735101] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.737143] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.737143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.737143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.737143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.737143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.737143] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.234340] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2889969-ebaf-471e-b592-cc2c82c2f544 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.234633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.234696] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2889969-ebaf-471e-b592-cc2c82c2f544',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.235684] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dec9e7e-dc37-4797-873c-10ec2ee64c44 with status ACTIVE [ 651.235828] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.235950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.236034] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.236246] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.236336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.236547] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.237829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.237829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.237829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.237829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.241253] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.241375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.241447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.241648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.241738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.241831] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dec9e7e-dc37-4797-873c-10ec2ee64c44 is going to be updated. [ 651.243240] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.243336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.243443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.243537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.243619] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.243818] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.243918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.244066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.244142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.244235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.244337] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 already deleted. [ 651.244692] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.264527] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.264679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.264748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.264948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.265096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.265402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dec9e7e-dc37-4797-873c-10ec2ee64c44" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.441480] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f140365e-2848-4938-ba34-06e4b21ec256 in Status: SUCCESS [ 651.441694] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.474889] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.475095] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-95" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.475146] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-95" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.475497] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-95" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.475769] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.475930] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.477330] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.478103] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.478103] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.478103] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.478103] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.478366] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.478366] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.478443] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.478481] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.478620] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.500303] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.500512] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 651.500672] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.500918] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-95" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.501192] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-f700537d-1847-40f2-b75c-543139ce3ac2 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.501587] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-f700537d-1847-40f2-b75c-543139ce3ac2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.501587] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-f700537d-1847-40f2-b75c-543139ce3ac2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.502025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-f700537d-1847-40f2-b75c-543139ce3ac2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.502267] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f700537d-1847-40f2-b75c-543139ce3ac2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.743943] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2889969-ebaf-471e-b592-cc2c82c2f544',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.908747] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 in Status: SUCCESS [ 651.909031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.909853] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 651.910073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.910340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.910522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.910759] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.910903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.910970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.913200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.913315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.913418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.913536] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.914607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.914806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.915031] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.915165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.915235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.915420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.915564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.915622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.916771] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.916771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.916771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.918214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.918214] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.918214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.918214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.918214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.918214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.918214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.918214] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.004706] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.004921] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.005102] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.005390] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.005560] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.005719] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port f700537d-1847-40f2-b75c-543139ce3ac2 not found, creating... [ 652.006399] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.006698] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.006761] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.007107] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.007182] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.007490] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.007655] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.007783] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.008011] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.008308] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.008521] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: f700537d-1847-40f2-b75c-543139ce3ac2 is going to be created. [ 652.027680] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.027898] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.028061] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.028451] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.028820] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.028944] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-f700537d-1847-40f2-b75c-543139ce3ac2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.249179] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.249179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.249179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.249179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.249179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.249179] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2889969-ebaf-471e-b592-cc2c82c2f544 is going to be created. [ 652.269463] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.269634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.269704] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.269923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.270110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.278835] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2889969-ebaf-471e-b592-cc2c82c2f544 in Status: UNINITIALIZED for 2s [ 652.422105] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.423291] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51d37fb6-4b72-4eba-930a-b89442ed8859: rpc.has_security_group_logging(os_id): False [ 652.442380] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.442561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.442648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.442910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.443038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.443309] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.443467] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.443583] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.443734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.443839] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.444094] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.444216] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.444290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.444457] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.444566] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.444814] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.444951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.445560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.446207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.446207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.446207] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 652.521947] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.521947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.521947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.521947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.521947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.548081] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 652.925441] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aebfc4ad-c9f8-4810-8396-c3dbd5247dc8: rpc.has_security_group_logging(os_id): False [ 652.945019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.945180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.945301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.945505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.945588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.945771] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.945872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.945935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.946569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.946569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.946569] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 is going to be updated. [ 653.003377] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.005497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.005497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.005497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.005497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.020865] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 in Status: IN_PROGRESS for 2s [ 653.357115] env[69499]: INFO networking_nsxv3.common.synchronization [req-e8bce72a-dfe8-4844-bf16-626824fc17ce req-6d0c7afe-009c-4e1a-99a6-614dc59c5fb2 tempest-ServerPasswordTestJSON-1623388183 tempest-ServerPasswordTestJSON-1623388183-project-member] Enqueued Resource ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b with Priority: HIGHEST for action security_group_members [ 653.358925] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b with Priority: HIGHEST for action security_group_members [ 653.358925] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93339c-e2b4-45e0-a4c1-b3051b85774b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.358925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.358925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.358925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.358925] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.358925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.358925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.358925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.358925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.359383] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a93339c-e2b4-45e0-a4c1-b3051b85774b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.561601] env[69499]: INFO networking_nsxv3.common.synchronization [req-8912fb74-cf1a-499d-bacb-0de3391ad575 req-aba9d60f-c884-4d6e-82af-46ff087fc764 service nova] Enqueued Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_rules [ 653.561828] env[69499]: INFO networking_nsxv3.common.synchronization [req-8912fb74-cf1a-499d-bacb-0de3391ad575 req-aba9d60f-c884-4d6e-82af-46ff087fc764 service nova] Enqueued Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_members [ 653.561948] env[69499]: INFO networking_nsxv3.common.synchronization [req-8912fb74-cf1a-499d-bacb-0de3391ad575 req-aba9d60f-c884-4d6e-82af-46ff087fc764 service nova] Enqueued Resource ID: f700537d-1847-40f2-b75c-543139ce3ac2 with Priority: HIGHEST for action port [ 653.562713] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_rules [ 653.562713] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_members [ 653.562713] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f700537d-1847-40f2-b75c-543139ce3ac2 with Priority: HIGHEST for action port [ 653.563222] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04847a44-8459-4dcc-b6cd-80a364fba3d0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.563425] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.563425] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.563733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.563812] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.565100] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-04847a44-8459-4dcc-b6cd-80a364fba3d0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.565223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.565402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.565595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.565763] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.565906] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.565977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.566078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.566174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.566262] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.567421] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-f700537d-1847-40f2-b75c-543139ce3ac2 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.567642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f700537d-1847-40f2-b75c-543139ce3ac2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.567707] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f700537d-1847-40f2-b75c-543139ce3ac2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.567871] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f700537d-1847-40f2-b75c-543139ce3ac2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.567949] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f700537d-1847-40f2-b75c-543139ce3ac2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.615030] env[69499]: INFO networking_nsxv3.common.synchronization [req-549acbc8-942b-42bf-acd4-535435e995ae req-58040388-97a7-46ef-a6ac-3cb3765a15be tempest-AttachInterfacesV270Test-1083569281 tempest-AttachInterfacesV270Test-1083569281-project-member] Enqueued Resource ID: 99e9e6e3-beeb-4449-ad6b-772723544abd with Priority: HIGHEST for action security_group_members [ 653.617465] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e9e6e3-beeb-4449-ad6b-772723544abd with Priority: HIGHEST for action security_group_members [ 653.617465] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e9e6e3-beeb-4449-ad6b-772723544abd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.617465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.617465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.617465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.617465] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.617465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.617465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.617465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.617465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.617465] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99e9e6e3-beeb-4449-ad6b-772723544abd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.670262] env[69499]: INFO networking_nsxv3.common.synchronization [None req-c6802359-eb86-4d7f-ad03-be7a8dc62d53 None None] Enqueued Resource ID: d3a53ee3-96d1-45ac-9dce-2458ac323974 with Priority: HIGHEST for action port [ 653.670846] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3a53ee3-96d1-45ac-9dce-2458ac323974 with Priority: HIGHEST for action port [ 653.671550] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3a53ee3-96d1-45ac-9dce-2458ac323974 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.671550] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3a53ee3-96d1-45ac-9dce-2458ac323974" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.671550] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3a53ee3-96d1-45ac-9dce-2458ac323974" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.671759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3a53ee3-96d1-45ac-9dce-2458ac323974" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.671759] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3a53ee3-96d1-45ac-9dce-2458ac323974',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.865468] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.865468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.865468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.865468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.865468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.865468] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.865468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.865468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.865468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.865468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.865468] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b is going to be updated. [ 653.898543] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.898543] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.898543] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.898543] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.898543] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.906099] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b in Status: IN_PROGRESS for 2s [ 654.066100] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-04847a44-8459-4dcc-b6cd-80a364fba3d0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.066100] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.071264] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.071264] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f700537d-1847-40f2-b75c-543139ce3ac2 with status ACTIVE [ 654.071264] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.071264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.071264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.071264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.071264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.071264] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.071264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.071264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.071264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.071264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.071264] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.071264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.071264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.071264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.072104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.072104] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f700537d-1847-40f2-b75c-543139ce3ac2 is going to be updated. [ 654.095438] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.098192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.098273] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.098518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.100442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.100442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f700537d-1847-40f2-b75c-543139ce3ac2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.119795] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.119945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.120048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.120262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.120352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.120553] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.120659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.120725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.120881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.120955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.121053] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e9e6e3-beeb-4449-ad6b-772723544abd already deleted. [ 654.121132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.174022] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3a53ee3-96d1-45ac-9dce-2458ac323974 [ 654.174022] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.174022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.174022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.174336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.174336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.174336] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3a53ee3-96d1-45ac-9dce-2458ac323974 already deleted. [ 654.174442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3a53ee3-96d1-45ac-9dce-2458ac323974" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.291778] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2889969-ebaf-471e-b592-cc2c82c2f544 in Status: SUCCESS [ 654.291994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.292604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.292604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.292742] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.292866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.292931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.293111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.293191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.293282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.293900] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2889969-ebaf-471e-b592-cc2c82c2f544',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.301816] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.301816] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-573" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.301816] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-573" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.301816] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-573" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.301816] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.301816] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.301816] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.301816] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.301816] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.301816] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.301816] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.301816] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.301816] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.302685] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.302685] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.302685] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.321952] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.321952] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 654.321952] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.321952] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-573" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.321952] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-47a31fa7-9458-42c2-8b6b-c548d06bd9fc taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.321952] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-47a31fa7-9458-42c2-8b6b-c548d06bd9fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.321952] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-47a31fa7-9458-42c2-8b6b-c548d06bd9fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.322354] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-47a31fa7-9458-42c2-8b6b-c548d06bd9fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.322535] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47a31fa7-9458-42c2-8b6b-c548d06bd9fc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.567014] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 654.567014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.567014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.567014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.567014] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.576385] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.799128] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2889969-ebaf-471e-b592-cc2c82c2f544 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.799349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.799465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.799744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.799963] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.800102] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.800190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.800382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.800548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.800610] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.800785] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2889969-ebaf-471e-b592-cc2c82c2f544 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.801107] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.801363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.802059] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.802059] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.802059] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.802059] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.802327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.802327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.802429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.802545] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2889969-ebaf-471e-b592-cc2c82c2f544',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.824775] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.826952] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.827132] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.827471] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.827641] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.827831] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 47a31fa7-9458-42c2-8b6b-c548d06bd9fc not found, creating... [ 654.828140] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.828321] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.831019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.831019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.831019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.831019] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.831019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.831019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.831581] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.831581] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.831653] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 47a31fa7-9458-42c2-8b6b-c548d06bd9fc is going to be created. [ 654.853410] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.854748] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.854748] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.855767] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.855767] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.858427] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-47a31fa7-9458-42c2-8b6b-c548d06bd9fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.006425] env[69499]: INFO networking_nsxv3.common.synchronization [req-bc4c55d6-dab6-4041-be69-c567d6862e06 req-fc0f64f1-7f58-49d8-942a-5e40fcd74f9c tempest-ServerExternalEventsTest-1698657151 tempest-ServerExternalEventsTest-1698657151-project-member] Enqueued Resource ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 with Priority: HIGHEST for action security_group_members [ 655.008222] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 with Priority: HIGHEST for action security_group_members [ 655.008972] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdad69f2-7aae-47fc-97ab-2b17246d7e21 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.009261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.009424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.009710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.009960] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.010203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.010357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.011095] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.011286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.011469] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdad69f2-7aae-47fc-97ab-2b17246d7e21',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.032979] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 in Status: SUCCESS [ 655.032979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.069637] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.069801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.069866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.070102] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.070264] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.070364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.070422] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.070577] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.070665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.070762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.070955] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.079206] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.079357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.079421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.079876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.079876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.079876] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 is going to be created. [ 655.108035] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.108035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.108035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.108035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.108035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.116417] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: UNINITIALIZED for 2s [ 655.305194] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2889969-ebaf-471e-b592-cc2c82c2f544: rpc.has_security_group_logging(os_id): False [ 655.307544] env[69499]: INFO networking_nsxv3.common.synchronization [None req-d329e10a-941c-43a9-93d0-658e93937061 None None] Enqueued Resource ID: b1744cf6-d8fc-4687-9920-0f0d68dc57e1 with Priority: HIGHEST for action port [ 655.307717] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1744cf6-d8fc-4687-9920-0f0d68dc57e1 with Priority: HIGHEST for action port [ 655.308398] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1744cf6-d8fc-4687-9920-0f0d68dc57e1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.308919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1744cf6-d8fc-4687-9920-0f0d68dc57e1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.308998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1744cf6-d8fc-4687-9920-0f0d68dc57e1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.309250] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1744cf6-d8fc-4687-9920-0f0d68dc57e1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.309328] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1744cf6-d8fc-4687-9920-0f0d68dc57e1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.334440] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.334591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.334661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.334865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.334950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.335175] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.335269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.335328] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.335540] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.335636] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.335821] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.335910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.335967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.336124] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.336202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.336383] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.336530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.337525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.337525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.337525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.337525] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2889969-ebaf-471e-b592-cc2c82c2f544 is going to be created. [ 655.396577] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.396577] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.396577] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.396577] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.396577] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.408721] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2889969-ebaf-471e-b592-cc2c82c2f544 in Status: IN_PROGRESS for 2s [ 655.519448] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.519448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.519448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.519448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.519448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.519448] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.519448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.519448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.519448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.519448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.519448] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 is going to be updated. [ 655.549800] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.549800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.549800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.549800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.549800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.558037] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 in Status: IN_PROGRESS for 2s [ 655.575248] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.575248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.575248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.575248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.575248] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.575248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.575248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.575248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.575248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.575248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.575824] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.575824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.575824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.576288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.576288] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.576288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.576422] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.576641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.576772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.577043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.577043] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.646995] env[69499]: INFO networking_nsxv3.common.synchronization [req-549acbc8-942b-42bf-acd4-535435e995ae req-57e3063e-6add-4ed4-8adf-584c59e16192 service nova] Enqueued Resource ID: 99e9e6e3-beeb-4449-ad6b-772723544abd with Priority: HIGHEST for action security_group_rules [ 655.647200] env[69499]: INFO networking_nsxv3.common.synchronization [req-549acbc8-942b-42bf-acd4-535435e995ae req-57e3063e-6add-4ed4-8adf-584c59e16192 service nova] Enqueued Resource ID: 99e9e6e3-beeb-4449-ad6b-772723544abd with Priority: HIGHEST for action security_group_members [ 655.647345] env[69499]: INFO networking_nsxv3.common.synchronization [req-549acbc8-942b-42bf-acd4-535435e995ae req-57e3063e-6add-4ed4-8adf-584c59e16192 service nova] Enqueued Resource ID: 47a31fa7-9458-42c2-8b6b-c548d06bd9fc with Priority: HIGHEST for action port [ 655.647727] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e9e6e3-beeb-4449-ad6b-772723544abd with Priority: HIGHEST for action security_group_rules [ 655.647727] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e9e6e3-beeb-4449-ad6b-772723544abd with Priority: HIGHEST for action security_group_members [ 655.647852] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a31fa7-9458-42c2-8b6b-c548d06bd9fc with Priority: HIGHEST for action port [ 655.648382] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99e9e6e3-beeb-4449-ad6b-772723544abd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.648556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.648653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.648862] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.648941] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99e9e6e3-beeb-4449-ad6b-772723544abd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.650115] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e9e6e3-beeb-4449-ad6b-772723544abd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.650231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.650294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.650476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.651094] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.651094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.651094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.651094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.651094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.651094] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99e9e6e3-beeb-4449-ad6b-772723544abd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.652264] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-47a31fa7-9458-42c2-8b6b-c548d06bd9fc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.652264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47a31fa7-9458-42c2-8b6b-c548d06bd9fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.652489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47a31fa7-9458-42c2-8b6b-c548d06bd9fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.654781] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47a31fa7-9458-42c2-8b6b-c548d06bd9fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.654781] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47a31fa7-9458-42c2-8b6b-c548d06bd9fc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.816375] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1744cf6-d8fc-4687-9920-0f0d68dc57e1 [ 655.816375] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.816375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.816375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.816375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.816375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.816375] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1744cf6-d8fc-4687-9920-0f0d68dc57e1 already deleted. [ 655.816375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1744cf6-d8fc-4687-9920-0f0d68dc57e1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.920152] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b in Status: SUCCESS [ 655.920152] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b deletion is rescheduled due to dependency. [ 655.920152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.005970] env[69499]: INFO networking_nsxv3.common.synchronization [None req-9e043f98-06a1-4773-a6b5-7cd7930f9f5b None None] Enqueued Resource ID: 6fff8f72-63b0-4fe6-b0bc-e5ccc80fd268 with Priority: HIGHEST for action port [ 656.006249] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fff8f72-63b0-4fe6-b0bc-e5ccc80fd268 with Priority: HIGHEST for action port [ 656.006829] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fff8f72-63b0-4fe6-b0bc-e5ccc80fd268 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.006968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fff8f72-63b0-4fe6-b0bc-e5ccc80fd268" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.007040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fff8f72-63b0-4fe6-b0bc-e5ccc80fd268" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.007398] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fff8f72-63b0-4fe6-b0bc-e5ccc80fd268" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.007398] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fff8f72-63b0-4fe6-b0bc-e5ccc80fd268',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.079692] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51d37fb6-4b72-4eba-930a-b89442ed8859: rpc.has_security_group_logging(os_id): False [ 656.098414] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.099564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.099674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.100059] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.100756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.103503] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.103858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.103956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.104188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.104822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.105260] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.107251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.107373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.107587] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.107714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.107981] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.108145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.108226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.108407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.108593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.108716] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 656.155611] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e9e6e3-beeb-4449-ad6b-772723544abd taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.155752] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.155918] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99e9e6e3-beeb-4449-ad6b-772723544abd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.157850] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47a31fa7-9458-42c2-8b6b-c548d06bd9fc with status ACTIVE [ 656.158064] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.158193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.158255] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.158458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.158548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.158717] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.158830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.158898] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.159066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.159141] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.159325] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.159430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.159750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.159938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.160135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.160135] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47a31fa7-9458-42c2-8b6b-c548d06bd9fc is going to be updated. [ 656.171877] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.172758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.174021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.174021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.174021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.180399] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.180533] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.180611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.180813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.181136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.181136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47a31fa7-9458-42c2-8b6b-c548d06bd9fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.191075] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 656.338152] env[69499]: INFO networking_nsxv3.common.synchronization [None req-f7f53663-8ff8-4390-b767-93635243f1e1 tempest-ServerActionsTestJSON-629709431 tempest-ServerActionsTestJSON-629709431-project-member] Enqueued Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_rules [ 656.338811] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_rules [ 656.339317] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.339451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.339516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.339758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.339832] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.480916] env[69499]: INFO networking_nsxv3.common.synchronization [None req-64fd39dd-5159-47d9-9274-23611e2f6f51 tempest-ServerActionsTestJSON-629709431 tempest-ServerActionsTestJSON-629709431-project-member] Enqueued Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_rules [ 656.480916] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_rules [ 656.480916] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.480916] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.514040] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fff8f72-63b0-4fe6-b0bc-e5ccc80fd268 [ 656.514040] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.514040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.514040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.514040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.514040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.514040] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fff8f72-63b0-4fe6-b0bc-e5ccc80fd268 already deleted. [ 656.514040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fff8f72-63b0-4fe6-b0bc-e5ccc80fd268" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.660319] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99e9e6e3-beeb-4449-ad6b-772723544abd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.870664] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.870829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.870901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.871187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.871331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.871406] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 already deleted. [ 656.871491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.871874] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.871874] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.871983] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.130338] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: UNINITIALIZED for 4s [ 657.163653] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.163847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.164098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.164225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.164407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.164697] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e9e6e3-beeb-4449-ad6b-772723544abd is going to be created. [ 657.187747] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.187895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.187951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.188239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.188585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.200016] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e9e6e3-beeb-4449-ad6b-772723544abd in Status: UNINITIALIZED for 2s [ 657.398418] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.398418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.398418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.398418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.398418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.398418] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 already deleted. [ 657.398418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.422669] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2889969-ebaf-471e-b592-cc2c82c2f544 in Status: SUCCESS [ 657.422669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.570064] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 in Status: SUCCESS [ 657.570064] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 deletion is rescheduled due to dependency. [ 657.570064] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.860886] env[69499]: INFO networking_nsxv3.common.synchronization [None req-7bd3a29d-2849-4479-ac2f-d300406af987 None None] Enqueued Resource ID: 72440155-bd6c-4cee-8125-74c94b82b6ec with Priority: HIGHEST for action port [ 657.861585] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72440155-bd6c-4cee-8125-74c94b82b6ec with Priority: HIGHEST for action port [ 657.861719] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-72440155-bd6c-4cee-8125-74c94b82b6ec taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.861936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72440155-bd6c-4cee-8125-74c94b82b6ec" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.861936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72440155-bd6c-4cee-8125-74c94b82b6ec" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.862253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72440155-bd6c-4cee-8125-74c94b82b6ec" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.862380] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72440155-bd6c-4cee-8125-74c94b82b6ec',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.210125] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 658.210445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.358020] env[69499]: INFO networking_nsxv3.common.synchronization [req-be8d5d13-6490-4b29-9a75-87fac0af67ac req-acca050d-1907-4c97-8081-c5c0e3560134 tempest-ServersAdminTestJSON-2112223204 tempest-ServersAdminTestJSON-2112223204-project-member] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 658.358020] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 658.358693] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.360509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.360509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.360509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.360509] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.360509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.360509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.360509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.360509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.360509] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.365718] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72440155-bd6c-4cee-8125-74c94b82b6ec [ 658.365718] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.365971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.365971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.366121] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.366216] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.366384] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72440155-bd6c-4cee-8125-74c94b82b6ec already deleted. [ 658.366473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72440155-bd6c-4cee-8125-74c94b82b6ec" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.867014] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.867391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.867391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.867391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.867519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.867934] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.867934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.867934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.868180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.868180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.868468] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 already deleted. [ 658.868468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.899297] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-797 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.903020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.903020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.903020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.903020] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.903020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.903020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.903020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.903020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.903020] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 658.903020] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.903020] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.903020] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.903020] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 658.903020] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.903020] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.921311] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.921311] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 658.921311] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.921311] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.921311] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-19bbfc78-4198-455c-8f71-138bc384318b taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.921311] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-19bbfc78-4198-455c-8f71-138bc384318b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.921311] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-19bbfc78-4198-455c-8f71-138bc384318b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.921812] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-19bbfc78-4198-455c-8f71-138bc384318b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.921812] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19bbfc78-4198-455c-8f71-138bc384318b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.142499] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: SUCCESS [ 659.143254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.143254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.143254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.143503] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.143584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.143631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.145035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.145035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.145035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.145035] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.217027] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e9e6e3-beeb-4449-ad6b-772723544abd in Status: SUCCESS [ 659.217027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.217205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.217342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.217578] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.217804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.217874] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.218049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.218137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.218225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.218321] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99e9e6e3-beeb-4449-ad6b-772723544abd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.425655] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.426948] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.426948] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.426948] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.426948] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.427411] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 19bbfc78-4198-455c-8f71-138bc384318b not found, creating... [ 659.427912] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.429550] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.429550] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.429550] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.429550] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.429550] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.429550] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.429550] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.430146] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.430146] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.430146] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 19bbfc78-4198-455c-8f71-138bc384318b is going to be created. [ 659.460229] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.460379] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.460510] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.460840] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.461110] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.461344] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-19bbfc78-4198-455c-8f71-138bc384318b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.647439] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-04847a44-8459-4dcc-b6cd-80a364fba3d0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.647932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.647932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.647932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.648072] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.648207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.648262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.648392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.648453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.648541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.649970] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-04847a44-8459-4dcc-b6cd-80a364fba3d0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.649970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.649970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.649970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.649970] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.649970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.649970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.649970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.649970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.649970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.649970] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.721053] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e9e6e3-beeb-4449-ad6b-772723544abd taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.721053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.721053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.721053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.721402] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.721402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.721402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.721613] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.721613] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.721713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.721849] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e9e6e3-beeb-4449-ad6b-772723544abd taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.721926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.721983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.722140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.722278] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.722367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.722427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.722567] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.722646] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.722725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.722826] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99e9e6e3-beeb-4449-ad6b-772723544abd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.152104] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04847a44-8459-4dcc-b6cd-80a364fba3d0: rpc.has_security_group_logging(os_id): False [ 660.172204] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.172204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.172204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.172553] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.172553] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.173187] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.173187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.173187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.173493] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.173493] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.173692] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.174722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.174814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.174948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.175083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.175357] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.175462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.175738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.175738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.175862] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.175862] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 is going to be created. [ 660.224916] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99e9e6e3-beeb-4449-ad6b-772723544abd: rpc.has_security_group_logging(os_id): False [ 660.229031] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.229289] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.229289] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.230270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.230450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.253046] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.253253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.253253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.253374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.253445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.253650] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.253753] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.253812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.253962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.254119] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.254262] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.254474] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.254474] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.254579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.254615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.254815] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.254904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.254973] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.257565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.257565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.257565] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99e9e6e3-beeb-4449-ad6b-772723544abd is going to be created. [ 660.257565] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: IN_PROGRESS for 2s [ 660.262627] env[69499]: INFO networking_nsxv3.common.synchronization [req-be8d5d13-6490-4b29-9a75-87fac0af67ac req-d0dc40e1-2eae-4070-8239-be1faaade4ad service nova] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_rules [ 660.262789] env[69499]: INFO networking_nsxv3.common.synchronization [req-be8d5d13-6490-4b29-9a75-87fac0af67ac req-d0dc40e1-2eae-4070-8239-be1faaade4ad service nova] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 660.262920] env[69499]: INFO networking_nsxv3.common.synchronization [req-be8d5d13-6490-4b29-9a75-87fac0af67ac req-d0dc40e1-2eae-4070-8239-be1faaade4ad service nova] Enqueued Resource ID: 19bbfc78-4198-455c-8f71-138bc384318b with Priority: HIGHEST for action port [ 660.263649] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_rules [ 660.263649] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 660.263649] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19bbfc78-4198-455c-8f71-138bc384318b with Priority: HIGHEST for action port [ 660.263959] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.264135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.264180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.264385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.264464] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.266027] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.267552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.267552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.267552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.267552] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.267552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.267552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.267552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.267552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.267552] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.267979] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-19bbfc78-4198-455c-8f71-138bc384318b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.267979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19bbfc78-4198-455c-8f71-138bc384318b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.268108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19bbfc78-4198-455c-8f71-138bc384318b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.268174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19bbfc78-4198-455c-8f71-138bc384318b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.268246] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19bbfc78-4198-455c-8f71-138bc384318b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.330020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.330166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.330234] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.330455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.330634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.341432] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99e9e6e3-beeb-4449-ad6b-772723544abd in Status: IN_PROGRESS for 2s [ 660.771271] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.777600] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.777600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.777600] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19bbfc78-4198-455c-8f71-138bc384318b with status ACTIVE [ 660.777600] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.777600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.777600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.777600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.777600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.777600] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.777600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.777600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.777600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.777600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.777600] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.778756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.778756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.778756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.778756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.778756] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19bbfc78-4198-455c-8f71-138bc384318b is going to be updated. [ 660.802472] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.802633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.802682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.803646] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.803646] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.803646] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19bbfc78-4198-455c-8f71-138bc384318b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.281232] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.327770] env[69499]: INFO networking_nsxv3.common.synchronization [req-4cf5ad32-c910-4a11-862a-03052d2084d0 req-96282c73-2d17-47d3-81c9-cb5c21657bde tempest-ServersAdminTestJSON-2112223204 tempest-ServersAdminTestJSON-2112223204-project-member] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 661.327770] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 661.327770] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.327770] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.786486] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.786486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.786486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.786486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.786486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.786486] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be created. [ 661.850212] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.851237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.851970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.852502] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.855754] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.863777] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: UNINITIALIZED for 2s [ 662.003019] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-797 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.003019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.003019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.003019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.003019] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.003019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.003019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.003019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.003539] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.003865] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.004100] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.004336] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.004547] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.004764] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.004970] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.005213] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.024168] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.024168] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 662.024168] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.024168] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.024168] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-988ebf1d-031a-4cdd-a647-00ade8cae02a taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.024168] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-988ebf1d-031a-4cdd-a647-00ade8cae02a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.024168] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-988ebf1d-031a-4cdd-a647-00ade8cae02a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.024168] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-988ebf1d-031a-4cdd-a647-00ade8cae02a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.024168] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('988ebf1d-031a-4cdd-a647-00ade8cae02a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.270790] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: SUCCESS [ 662.273463] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.354364] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99e9e6e3-beeb-4449-ad6b-772723544abd in Status: SUCCESS [ 662.357072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.526820] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.527123] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.527264] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.527655] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.527748] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.527902] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 988ebf1d-031a-4cdd-a647-00ade8cae02a not found, creating... [ 662.528717] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.528717] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.528717] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.529291] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.529291] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.529426] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.529549] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.529671] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.529909] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.530065] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.530228] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 988ebf1d-031a-4cdd-a647-00ade8cae02a is going to be created. [ 662.556047] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.556279] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.556341] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.556630] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.556868] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.557120] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-988ebf1d-031a-4cdd-a647-00ade8cae02a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.351380] env[69499]: INFO networking_nsxv3.common.synchronization [req-4cf5ad32-c910-4a11-862a-03052d2084d0 req-62601113-ce01-41c6-a198-a74b95e0f0f0 service nova] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_rules [ 663.351873] env[69499]: INFO networking_nsxv3.common.synchronization [req-4cf5ad32-c910-4a11-862a-03052d2084d0 req-62601113-ce01-41c6-a198-a74b95e0f0f0 service nova] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 663.352378] env[69499]: INFO networking_nsxv3.common.synchronization [req-4cf5ad32-c910-4a11-862a-03052d2084d0 req-62601113-ce01-41c6-a198-a74b95e0f0f0 service nova] Enqueued Resource ID: 988ebf1d-031a-4cdd-a647-00ade8cae02a with Priority: HIGHEST for action port [ 663.353364] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_rules [ 663.354401] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 663.354401] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988ebf1d-031a-4cdd-a647-00ade8cae02a with Priority: HIGHEST for action port [ 663.354401] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.354401] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.355409] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.355409] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.355409] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-988ebf1d-031a-4cdd-a647-00ade8cae02a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.355409] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-988ebf1d-031a-4cdd-a647-00ade8cae02a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.355409] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-988ebf1d-031a-4cdd-a647-00ade8cae02a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.356741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-988ebf1d-031a-4cdd-a647-00ade8cae02a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.356741] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('988ebf1d-031a-4cdd-a647-00ade8cae02a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.859402] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 988ebf1d-031a-4cdd-a647-00ade8cae02a with status ACTIVE [ 663.859674] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.859844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.860037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.860159] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.860253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.861377] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.861377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.861377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.861377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.861377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.861377] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.861377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.861377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.861377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.861838] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.861838] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 988ebf1d-031a-4cdd-a647-00ade8cae02a is going to be updated. [ 663.874718] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 663.874954] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.875151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.875378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.875601] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.875679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.875748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.875908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.875999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.876105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.876206] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.877196] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.877370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.877541] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.877911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.877911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.877911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.878118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.878118] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.881927] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.882070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.882143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.882326] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.882572] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.882637] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-988ebf1d-031a-4cdd-a647-00ade8cae02a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.379544] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.380039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.380039] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.882529] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.389465] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.390023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.390164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.390477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.390626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.390800] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be updated. [ 665.448706] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.448949] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.448995] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.449220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.449378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.458978] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 666.791669] env[69499]: INFO networking_nsxv3.common.synchronization [req-182be6a5-ca29-4c42-a669-d37a9cd032f7 req-a021f4f8-5d5c-45a7-9d8e-fe1305d83047 tempest-VolumesAdminNegativeTest-1747404511 tempest-VolumesAdminNegativeTest-1747404511-project-member] Enqueued Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGHEST for action security_group_members [ 666.792798] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGHEST for action security_group_members [ 666.792798] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c134d579-1162-46e0-bee7-73f3403c9135 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.792963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.792963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.793217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.793401] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.793505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.793629] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.793759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.793865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.793963] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c134d579-1162-46e0-bee7-73f3403c9135',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.107038] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.107212] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-353" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.107384] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-353" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.107863] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-353" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.109665] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.109665] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.109665] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.109665] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.109665] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.109665] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.109665] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.110076] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.110076] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.110076] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.110237] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.110590] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.129886] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.130172] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 667.130338] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.130579] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-353" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.131197] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-f394e7ea-1293-4091-82d6-8222b86516ae taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.131379] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-f394e7ea-1293-4091-82d6-8222b86516ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.131478] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-f394e7ea-1293-4091-82d6-8222b86516ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.131940] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-f394e7ea-1293-4091-82d6-8222b86516ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.132117] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f394e7ea-1293-4091-82d6-8222b86516ae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.297453] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.297698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.297802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.298080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.298256] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.298499] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.298606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.298678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.298950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.299114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.299201] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c134d579-1162-46e0-bee7-73f3403c9135 already deleted. [ 667.299289] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.470177] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 667.470501] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.470773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.471087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.471322] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.471476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.471552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.471758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.471875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.471992] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.635018] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.635248] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.635408] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.635766] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.635929] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.636104] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port f394e7ea-1293-4091-82d6-8222b86516ae not found, creating... [ 667.636427] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.636772] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.636772] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.637034] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.637180] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.637475] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.637673] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.637862] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.638129] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.638309] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.638467] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: f394e7ea-1293-4091-82d6-8222b86516ae is going to be created. [ 667.657877] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.658148] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.658334] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.658654] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.658897] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.659143] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-f394e7ea-1293-4091-82d6-8222b86516ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.975132] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.355506] env[69499]: INFO networking_nsxv3.common.synchronization [req-182be6a5-ca29-4c42-a669-d37a9cd032f7 req-be637b4a-c243-4281-948d-ee2d7ae44ea0 service nova] Enqueued Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGHEST for action security_group_rules [ 668.355775] env[69499]: INFO networking_nsxv3.common.synchronization [req-182be6a5-ca29-4c42-a669-d37a9cd032f7 req-be637b4a-c243-4281-948d-ee2d7ae44ea0 service nova] Enqueued Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGHEST for action security_group_members [ 668.356008] env[69499]: INFO networking_nsxv3.common.synchronization [req-182be6a5-ca29-4c42-a669-d37a9cd032f7 req-be637b4a-c243-4281-948d-ee2d7ae44ea0 service nova] Enqueued Resource ID: f394e7ea-1293-4091-82d6-8222b86516ae with Priority: HIGHEST for action port [ 668.356806] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGHEST for action security_group_rules [ 668.356869] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGHEST for action security_group_members [ 668.357279] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f394e7ea-1293-4091-82d6-8222b86516ae with Priority: HIGHEST for action port [ 668.357692] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c134d579-1162-46e0-bee7-73f3403c9135 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.357870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.357973] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.358277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.358395] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c134d579-1162-46e0-bee7-73f3403c9135',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.359503] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c134d579-1162-46e0-bee7-73f3403c9135 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.360161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.360161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.360161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.360298] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.360343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.360461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.361046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.361046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.361046] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c134d579-1162-46e0-bee7-73f3403c9135',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.362322] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-f394e7ea-1293-4091-82d6-8222b86516ae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.362556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f394e7ea-1293-4091-82d6-8222b86516ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.362646] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f394e7ea-1293-4091-82d6-8222b86516ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.362869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f394e7ea-1293-4091-82d6-8222b86516ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.363051] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f394e7ea-1293-4091-82d6-8222b86516ae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.478224] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.865477] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c134d579-1162-46e0-bee7-73f3403c9135 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.865715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.865921] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c134d579-1162-46e0-bee7-73f3403c9135',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.868750] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f394e7ea-1293-4091-82d6-8222b86516ae with status ACTIVE [ 668.869025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.869115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.869145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.869369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.869471] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.869790] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.869790] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.869961] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.870027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.870082] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.870265] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.870362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.870465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.870556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.870631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.870719] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f394e7ea-1293-4091-82d6-8222b86516ae is going to be updated. [ 668.890497] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.890687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.890764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.890992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.891178] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.891352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f394e7ea-1293-4091-82d6-8222b86516ae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.980591] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.980880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.980880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.981221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.981350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.981458] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be updated. [ 669.023135] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.023298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.023370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.023594] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.023746] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.033533] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 669.373083] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c134d579-1162-46e0-bee7-73f3403c9135',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.875483] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.875736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.875736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.876053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.876232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.876406] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c134d579-1162-46e0-bee7-73f3403c9135 is going to be created. [ 669.900232] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.900480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.900527] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.900784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.900998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.915537] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c134d579-1162-46e0-bee7-73f3403c9135 in Status: UNINITIALIZED for 2s [ 671.043423] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 671.043767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.043767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.044390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.044390] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.044390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.044602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.044636] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.044733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.044902] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.044980] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.045113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.045172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.045368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.045519] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.045637] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.045703] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.045874] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.045960] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.046316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.046422] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.550346] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 645b270d-e6d4-4f84-872d-3c097c5f4722: rpc.has_security_group_logging(os_id): False [ 671.567945] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.568650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.568730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.569041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.569172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.569336] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.569442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.569518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.569675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.571455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.571455] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.571455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.571455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.571455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.571455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.571455] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.571455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.571455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.571455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.571455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.571455] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be created. [ 671.625409] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.626451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.626451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.626451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.626451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.637148] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 671.925884] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c134d579-1162-46e0-bee7-73f3403c9135 in Status: SUCCESS [ 671.929088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.929088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.929088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.929088] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.929088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.929088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.929088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.929088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.929088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.929088] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c134d579-1162-46e0-bee7-73f3403c9135',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.431252] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c134d579-1162-46e0-bee7-73f3403c9135',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.933918] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c134d579-1162-46e0-bee7-73f3403c9135: rpc.has_security_group_logging(os_id): False [ 672.951518] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.951712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.951795] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.952055] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.952199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.952500] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.952603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.952670] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.952878] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.952987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.953101] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c134d579-1162-46e0-bee7-73f3403c9135 is going to be created. [ 673.010171] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.010341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.010415] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.010634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.010820] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.023569] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c134d579-1162-46e0-bee7-73f3403c9135 in Status: IN_PROGRESS for 2s [ 673.358743] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 673.358849] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 673.649077] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 673.650125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.650125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.650125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.650125] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.712017] env[69499]: INFO networking_nsxv3.common.synchronization [req-cbe6063c-7d4f-4327-b42e-dbcc6a132493 req-4c6fb39e-547c-41c7-a1f7-6d7c2d291ef1 tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_members [ 673.712017] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_members [ 673.712017] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.712017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.712017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.712017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.712017] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.712017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.712017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.712017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.712017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.712017] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.152732] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.152910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.152979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.153197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.153382] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.153493] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.153744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.153744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.153815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.154066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.154066] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.173855] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.174189] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.174189] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.174582] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.174887] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.175138] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.175229] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.175394] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.175537] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.175742] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.175862] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.175973] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.176094] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.176207] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.176545] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.176545] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.196050] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.196275] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 674.196431] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.196566] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.196938] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.197130] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.197299] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.197589] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.197879] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.214385] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.217719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.217719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.217719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.217719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.217719] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.217719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.217719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.217719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.217719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.217719] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd already deleted. [ 674.217719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.656862] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.656862] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.656862] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.657294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.657323] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.657492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.657587] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.657808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.657948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.658090] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.658279] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.658412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.658503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.658682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.658888] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.658994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.659072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.659221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.659306] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.659425] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.659524] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.701708] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.701939] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.702082] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.702377] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.702527] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.702681] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34 not found, creating... [ 674.702940] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.703109] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.703226] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.703449] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.703588] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.703909] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.704082] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.704197] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.704402] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.704533] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.704671] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34 is going to be created. [ 674.724860] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.725083] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.725212] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.725468] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.725696] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.725902] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.033455] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c134d579-1162-46e0-bee7-73f3403c9135 in Status: SUCCESS [ 675.033679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.161509] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 645b270d-e6d4-4f84-872d-3c097c5f4722: rpc.has_security_group_logging(os_id): False [ 675.183587] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.183732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.183808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.184033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.184135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.184689] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.184689] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.184689] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.184689] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.184689] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.184978] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.184978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.185090] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.185173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.185247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.185441] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.185537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.185593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.185735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.185810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.185896] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be updated. [ 675.243297] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.243438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.243501] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.243711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.243844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.255955] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 675.504253] env[69499]: INFO networking_nsxv3.common.synchronization [req-cbe6063c-7d4f-4327-b42e-dbcc6a132493 req-15d2bf1c-2c83-4a97-8cb4-526ab1a125e3 service nova] Enqueued Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_rules [ 675.504253] env[69499]: INFO networking_nsxv3.common.synchronization [req-cbe6063c-7d4f-4327-b42e-dbcc6a132493 req-15d2bf1c-2c83-4a97-8cb4-526ab1a125e3 service nova] Enqueued Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_members [ 675.504253] env[69499]: INFO networking_nsxv3.common.synchronization [req-cbe6063c-7d4f-4327-b42e-dbcc6a132493 req-15d2bf1c-2c83-4a97-8cb4-526ab1a125e3 service nova] Enqueued Resource ID: e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34 with Priority: HIGHEST for action port [ 675.504253] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_rules [ 675.504253] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_members [ 675.504253] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34 with Priority: HIGHEST for action port [ 675.504817] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.504963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.505043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.505254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.505333] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.506192] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.506322] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.506383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.506546] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.506677] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.506778] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.509104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.509104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.509104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.509104] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.509104] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.509104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.509104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.509104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.509104] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.879123] env[69499]: INFO networking_nsxv3.common.synchronization [None req-78b263ce-7900-403e-aa37-37e3eba934ba None None] Enqueued Resource ID: 8ed4e638-f40c-4848-97a7-f269a2410166 with Priority: HIGHEST for action port [ 675.879123] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ed4e638-f40c-4848-97a7-f269a2410166 with Priority: HIGHEST for action port [ 675.879123] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ed4e638-f40c-4848-97a7-f269a2410166 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.879123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ed4e638-f40c-4848-97a7-f269a2410166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.879123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ed4e638-f40c-4848-97a7-f269a2410166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.879123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ed4e638-f40c-4848-97a7-f269a2410166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.879604] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ed4e638-f40c-4848-97a7-f269a2410166',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.010011] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.010140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.010442] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.011220] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34 with status ACTIVE [ 676.011371] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.011484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.011554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.011767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.013885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.014386] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.014386] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.014386] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.014508] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.014508] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.014727] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.014833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.014869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.015009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.015119] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.015160] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34 is going to be updated. [ 676.035870] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.036046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.036133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.036335] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.036556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.036622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3c3f4e6-fe0a-4d91-af6b-deb96aa2bc34" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.381630] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ed4e638-f40c-4848-97a7-f269a2410166 [ 676.381862] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.381999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.382082] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.382282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.382375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.382470] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ed4e638-f40c-4848-97a7-f269a2410166 already deleted. [ 676.382552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ed4e638-f40c-4848-97a7-f269a2410166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.517821] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.019847] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.020885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.020885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.020885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.020885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.020885] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd is going to be created. [ 677.046064] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.046064] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.046064] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.046064] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.046064] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.055962] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd in Status: UNINITIALIZED for 2s [ 677.267634] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 677.267881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.194122] env[69499]: INFO networking_nsxv3.common.synchronization [None req-1f36e48a-1085-428a-baae-2710a5f1ada2 None None] Enqueued Resource ID: 1098d5da-6f2c-4b2d-9772-d826d0c7d1d2 with Priority: HIGHEST for action port [ 678.194122] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1098d5da-6f2c-4b2d-9772-d826d0c7d1d2 with Priority: HIGHEST for action port [ 678.194122] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-1098d5da-6f2c-4b2d-9772-d826d0c7d1d2 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.194122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1098d5da-6f2c-4b2d-9772-d826d0c7d1d2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.194122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1098d5da-6f2c-4b2d-9772-d826d0c7d1d2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.194720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1098d5da-6f2c-4b2d-9772-d826d0c7d1d2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.194720] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1098d5da-6f2c-4b2d-9772-d826d0c7d1d2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.698072] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1098d5da-6f2c-4b2d-9772-d826d0c7d1d2 [ 678.698325] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.698467] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.698547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.698763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.698858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.698972] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1098d5da-6f2c-4b2d-9772-d826d0c7d1d2 already deleted. [ 678.699087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1098d5da-6f2c-4b2d-9772-d826d0c7d1d2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.071041] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd in Status: SUCCESS [ 679.071041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.071041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.071041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.071170] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.071228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.071271] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.072184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.072184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.072184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.072184] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.320360] env[69499]: INFO networking_nsxv3.common.synchronization [req-9d6dee3d-4bcd-4f25-b4cb-fcf631783a97 req-2adeeef8-52c9-43c5-a318-fce0ae54dad5 tempest-FloatingIPsAssociationNegativeTestJSON-1740764247 tempest-FloatingIPsAssociationNegativeTestJSON-1740764247-project-member] Enqueued Resource ID: b2889969-ebaf-471e-b592-cc2c82c2f544 with Priority: HIGHEST for action security_group_members [ 679.321580] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2889969-ebaf-471e-b592-cc2c82c2f544 with Priority: HIGHEST for action security_group_members [ 679.324955] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2889969-ebaf-471e-b592-cc2c82c2f544 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.324955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.324955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.324955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.324955] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.324955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.324955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.324955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.324955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.324955] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2889969-ebaf-471e-b592-cc2c82c2f544',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.426354] env[69499]: INFO networking_nsxv3.common.synchronization [req-d6d3eefc-094f-4e4c-95af-e2c752c8a8b3 req-ac01dcd1-3d50-4bf8-90f7-5c56db2fd8ed tempest-AttachInterfacesV270Test-1083569281 tempest-AttachInterfacesV270Test-1083569281-project-member] Enqueued Resource ID: 99e9e6e3-beeb-4449-ad6b-772723544abd with Priority: HIGHEST for action security_group_members [ 679.426933] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e9e6e3-beeb-4449-ad6b-772723544abd with Priority: HIGHEST for action security_group_members [ 679.427261] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e9e6e3-beeb-4449-ad6b-772723544abd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.427414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.427446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.427652] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.427814] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.427920] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.428123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.428315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.428408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.428506] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99e9e6e3-beeb-4449-ad6b-772723544abd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.577636] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.830582] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.830733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.830788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.831065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.831199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.831422] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.831588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.831781] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.831985] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.832173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.832428] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2889969-ebaf-471e-b592-cc2c82c2f544 is going to be updated. [ 679.858871] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.859074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.859111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.859303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.859445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.867918] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2889969-ebaf-471e-b592-cc2c82c2f544 in Status: IN_PROGRESS for 2s [ 679.932523] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.932674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.932750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.932973] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.933085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.933282] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.933382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.933444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.933596] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.933673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.933757] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e9e6e3-beeb-4449-ad6b-772723544abd is going to be updated. [ 679.959973] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.960201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.960201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.960414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.960554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.968825] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e9e6e3-beeb-4449-ad6b-772723544abd in Status: IN_PROGRESS for 2s [ 680.079296] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35e560ef-ae12-4b78-9fd4-fb9be25e66dd: rpc.has_security_group_logging(os_id): False [ 680.098562] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.098945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.099136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.099474] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.099626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.099903] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.100045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.100121] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.100289] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.100366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.100458] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd is going to be created. [ 680.158165] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.158304] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.158429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.158654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.158845] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.185098] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd in Status: IN_PROGRESS for 2s [ 681.876667] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2889969-ebaf-471e-b592-cc2c82c2f544 in Status: SUCCESS [ 681.876958] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2889969-ebaf-471e-b592-cc2c82c2f544 deletion is rescheduled due to dependency. [ 681.876991] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.977520] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e9e6e3-beeb-4449-ad6b-772723544abd in Status: SUCCESS [ 681.977714] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e9e6e3-beeb-4449-ad6b-772723544abd deletion is rescheduled due to dependency. [ 681.977830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e9e6e3-beeb-4449-ad6b-772723544abd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.195688] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd in Status: SUCCESS [ 682.196791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.534863] env[69499]: INFO networking_nsxv3.common.synchronization [req-c985edad-f15f-4c43-9249-7dc7fa0ac546 req-225a8989-d734-44e3-b94f-0d82d9a27561 tempest-ServerGroupTestJSON-377625122 tempest-ServerGroupTestJSON-377625122-project-member] Enqueued Resource ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 with Priority: HIGHEST for action security_group_members [ 682.535513] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 with Priority: HIGHEST for action security_group_members [ 682.535751] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-66a8ff79-7c57-42b0-afcb-f254b5d02311 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.535893] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.535940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.536376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.536548] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.536658] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.536728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.536893] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.536983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.537091] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66a8ff79-7c57-42b0-afcb-f254b5d02311',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.917981] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.918286] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-904" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.918322] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-904" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.919041] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-904" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.919041] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.919240] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.919388] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.919605] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.919743] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.919965] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.920160] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.920292] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.920292] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.920391] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.920628] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.920628] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.941750] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.941925] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.942132] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.944595] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-904" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.945173] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-0ab80268-64d5-4198-af59-f2da6989fafd taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.945486] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-0ab80268-64d5-4198-af59-f2da6989fafd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.945715] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-0ab80268-64d5-4198-af59-f2da6989fafd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.946087] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-0ab80268-64d5-4198-af59-f2da6989fafd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.946263] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ab80268-64d5-4198-af59-f2da6989fafd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.038762] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.039119] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.040491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.044663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.044663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.044663] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.044663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.044663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.044663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.044663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.044663] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 already deleted. [ 683.044663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.448582] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.448805] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.448936] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.449250] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.449402] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.449559] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 0ab80268-64d5-4198-af59-f2da6989fafd not found, creating... [ 683.449868] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.450939] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.450939] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.450939] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.450939] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.450939] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.451270] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.451270] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.451508] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.451584] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.451721] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 0ab80268-64d5-4198-af59-f2da6989fafd is going to be created. [ 683.472104] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.472314] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.472482] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.472759] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.473059] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.473305] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-0ab80268-64d5-4198-af59-f2da6989fafd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.331661] env[69499]: INFO networking_nsxv3.common.synchronization [req-45b6219a-196d-466b-9873-b669ca7c4a56 req-a3443e59-b0ad-40d9-8228-312abb715082 tempest-AttachInterfacesUnderV243Test-812043974 tempest-AttachInterfacesUnderV243Test-812043974-project-member] Enqueued Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_members [ 684.332160] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_members [ 684.332722] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.332722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.332722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.333459] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.333459] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.333459] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.333459] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.333459] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.333459] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.333753] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.521505] env[69499]: INFO networking_nsxv3.common.synchronization [req-c985edad-f15f-4c43-9249-7dc7fa0ac546 req-3251fa59-3ea1-46d3-884f-55e734a61c20 service nova] Enqueued Resource ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 with Priority: HIGHEST for action security_group_rules [ 684.521684] env[69499]: INFO networking_nsxv3.common.synchronization [req-c985edad-f15f-4c43-9249-7dc7fa0ac546 req-3251fa59-3ea1-46d3-884f-55e734a61c20 service nova] Enqueued Resource ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 with Priority: HIGHEST for action security_group_members [ 684.521820] env[69499]: INFO networking_nsxv3.common.synchronization [req-c985edad-f15f-4c43-9249-7dc7fa0ac546 req-3251fa59-3ea1-46d3-884f-55e734a61c20 service nova] Enqueued Resource ID: 0ab80268-64d5-4198-af59-f2da6989fafd with Priority: HIGHEST for action port [ 684.522358] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 with Priority: HIGHEST for action security_group_rules [ 684.522498] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 with Priority: HIGHEST for action security_group_members [ 684.522596] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab80268-64d5-4198-af59-f2da6989fafd with Priority: HIGHEST for action port [ 684.522860] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66a8ff79-7c57-42b0-afcb-f254b5d02311 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.522989] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.523048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.523299] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.523373] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66a8ff79-7c57-42b0-afcb-f254b5d02311',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.524216] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-66a8ff79-7c57-42b0-afcb-f254b5d02311 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.524353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.524415] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.524556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.524697] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.524865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.525040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.525365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.525482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.525587] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66a8ff79-7c57-42b0-afcb-f254b5d02311',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.526420] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ab80268-64d5-4198-af59-f2da6989fafd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.526545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ab80268-64d5-4198-af59-f2da6989fafd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.526773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ab80268-64d5-4198-af59-f2da6989fafd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.526773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ab80268-64d5-4198-af59-f2da6989fafd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.526896] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ab80268-64d5-4198-af59-f2da6989fafd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.835672] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.836465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.836589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.836775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.836900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.837135] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.837239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.837355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.837468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.837547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.837634] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 already deleted. [ 684.837716] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.842220] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-949 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.842449] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-949" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.842632] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-949" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.843034] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-949" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.843337] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.843503] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.843887] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.843970] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.844317] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.844577] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 684.844743] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.844902] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.845062] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.845197] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 684.845303] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.845438] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.866555] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.866734] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 684.866884] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.867121] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-949" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.867493] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-dca30808-33f5-4d40-bf37-ff5bceaed787 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.867702] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.867832] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.868269] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.868558] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dca30808-33f5-4d40-bf37-ff5bceaed787',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.028784] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66a8ff79-7c57-42b0-afcb-f254b5d02311',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.029988] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-66a8ff79-7c57-42b0-afcb-f254b5d02311 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.030154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.031668] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ab80268-64d5-4198-af59-f2da6989fafd with status ACTIVE [ 685.032925] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.032925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.032925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.032925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.032925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.032925] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.032925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.032925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.032925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.033361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.033361] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.033361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.033361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.033678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.033764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.033858] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ab80268-64d5-4198-af59-f2da6989fafd is going to be updated. [ 685.055683] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.055683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.055683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.055683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.055683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.055683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ab80268-64d5-4198-af59-f2da6989fafd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.370937] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.371338] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.371559] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.372015] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.372287] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.372552] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port dca30808-33f5-4d40-bf37-ff5bceaed787 not found, creating... [ 685.372982] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.373267] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.373469] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.373726] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.373873] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.374204] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.374454] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.374549] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.374735] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.374898] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.375037] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: dca30808-33f5-4d40-bf37-ff5bceaed787 is going to be created. [ 685.394066] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.394392] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.394457] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.394717] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.395057] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.395306] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.531331] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66a8ff79-7c57-42b0-afcb-f254b5d02311',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.033566] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.033752] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.033843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.034156] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.034268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.034397] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 is going to be created. [ 686.056497] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.056691] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.056797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.057137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.057332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.066567] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 in Status: UNINITIALIZED for 2s [ 686.103471] env[69499]: INFO networking_nsxv3.common.synchronization [req-45b6219a-196d-466b-9873-b669ca7c4a56 req-53063e81-0e57-4f41-8be3-7f5ddac81d10 service nova] Enqueued Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_rules [ 686.103817] env[69499]: INFO networking_nsxv3.common.synchronization [req-45b6219a-196d-466b-9873-b669ca7c4a56 req-53063e81-0e57-4f41-8be3-7f5ddac81d10 service nova] Enqueued Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_members [ 686.104075] env[69499]: INFO networking_nsxv3.common.synchronization [req-45b6219a-196d-466b-9873-b669ca7c4a56 req-53063e81-0e57-4f41-8be3-7f5ddac81d10 service nova] Enqueued Resource ID: dca30808-33f5-4d40-bf37-ff5bceaed787 with Priority: HIGHEST for action port [ 686.104912] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_rules [ 686.105100] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_members [ 686.105284] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dca30808-33f5-4d40-bf37-ff5bceaed787 with Priority: HIGHEST for action port [ 686.105708] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.105959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.106037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.106470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.106604] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.110700] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.110700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.110700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.110700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.110700] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.110700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.110700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.110700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.110700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.110700] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.110700] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-dca30808-33f5-4d40-bf37-ff5bceaed787 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.110700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.110700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.110700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.111250] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dca30808-33f5-4d40-bf37-ff5bceaed787',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.614042] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.614042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.614042] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dca30808-33f5-4d40-bf37-ff5bceaed787 with status ACTIVE [ 686.614042] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.614042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.614042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.614042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.614042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.614042] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.614042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.614042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.614796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.614796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.614796] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.614796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.614796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.614796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.614948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.615238] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dca30808-33f5-4d40-bf37-ff5bceaed787 is going to be updated. [ 686.616083] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.635686] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.635838] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.635890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.636116] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.636257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.636420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.119338] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.622132] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.622545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.622545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.622680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.622774] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.622876] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 is going to be created. [ 687.644159] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.644351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.644422] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.644618] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.644798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.654063] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 in Status: UNINITIALIZED for 2s [ 688.076642] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 in Status: SUCCESS [ 688.078251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.078251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.078251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.078251] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.078251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.078251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.078251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.078251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.078251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.078251] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66a8ff79-7c57-42b0-afcb-f254b5d02311',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.580623] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-66a8ff79-7c57-42b0-afcb-f254b5d02311 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.580836] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.580914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.581179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.581447] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.581581] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.581650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.581829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.581925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.582075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.582313] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-66a8ff79-7c57-42b0-afcb-f254b5d02311 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.582427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.582499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.582688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.582812] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.582965] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.583080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.583239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.583323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.583422] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.583517] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66a8ff79-7c57-42b0-afcb-f254b5d02311',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.882350] env[69499]: INFO networking_nsxv3.common.synchronization [req-f92579f5-a191-454b-80a5-ed0ae50326ca req-b10b2fb6-5078-4e8e-ac38-b6a72e132f65 tempest-ImagesOneServerNegativeTestJSON-1949881093 tempest-ImagesOneServerNegativeTestJSON-1949881093-project-member] Enqueued Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 688.882902] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 688.883256] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.883379] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.883448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.883707] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.884262] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.884262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.884262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.884397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.884397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.884493] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.085869] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66a8ff79-7c57-42b0-afcb-f254b5d02311: rpc.has_security_group_logging(os_id): False [ 689.102397] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.102520] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.102570] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.102761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.102850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.103066] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.103155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.103218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.103373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.103448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.103638] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.103730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.103791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.103927] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.104009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.104195] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.104285] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.104346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.105421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.105421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.105421] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 is going to be created. [ 689.158846] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.159013] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.159090] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.159310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.159489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.169397] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 in Status: IN_PROGRESS for 2s [ 689.184432] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.184624] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-245" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.184774] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-245" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.185146] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-245" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.185401] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.185563] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.185680] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.185902] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.186226] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.186461] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 689.186582] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.186696] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.186806] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.186950] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 689.187088] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.187226] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.227511] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.227693] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 689.227814] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.227996] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-245" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.228353] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-f8eb7a60-f68d-4721-a979-2ed5cc95172e taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.228541] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-f8eb7a60-f68d-4721-a979-2ed5cc95172e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.228664] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-f8eb7a60-f68d-4721-a979-2ed5cc95172e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.229016] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-f8eb7a60-f68d-4721-a979-2ed5cc95172e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.229158] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8eb7a60-f68d-4721-a979-2ed5cc95172e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.386698] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.386919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.387142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.387428] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.387586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.387914] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.388109] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.388187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.388388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.388503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.388576] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 already deleted. [ 689.388660] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.663732] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 in Status: SUCCESS [ 689.663887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.664108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.664349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.664544] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.664713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.664713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.664897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.664972] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.665214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.665214] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.731508] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.731855] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.731855] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.732157] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.732315] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.732470] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port f8eb7a60-f68d-4721-a979-2ed5cc95172e not found, creating... [ 689.732729] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.732902] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.733066] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.733271] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.733405] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.733695] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.733908] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.733963] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.734186] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.734317] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.734451] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: f8eb7a60-f68d-4721-a979-2ed5cc95172e is going to be created. [ 689.765148] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.765391] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.765588] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.765836] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.766233] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.766513] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-f8eb7a60-f68d-4721-a979-2ed5cc95172e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.167276] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.598275] env[69499]: INFO networking_nsxv3.common.synchronization [req-f92579f5-a191-454b-80a5-ed0ae50326ca req-9a3229d0-2786-4f57-9e38-243a2fb0abc6 service nova] Enqueued Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_rules [ 690.598275] env[69499]: INFO networking_nsxv3.common.synchronization [req-f92579f5-a191-454b-80a5-ed0ae50326ca req-9a3229d0-2786-4f57-9e38-243a2fb0abc6 service nova] Enqueued Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 690.598275] env[69499]: INFO networking_nsxv3.common.synchronization [req-f92579f5-a191-454b-80a5-ed0ae50326ca req-9a3229d0-2786-4f57-9e38-243a2fb0abc6 service nova] Enqueued Resource ID: f8eb7a60-f68d-4721-a979-2ed5cc95172e with Priority: HIGHEST for action port [ 690.598392] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_rules [ 690.600662] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 690.600662] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8eb7a60-f68d-4721-a979-2ed5cc95172e with Priority: HIGHEST for action port [ 690.600662] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.600662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.600662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.600662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.600662] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.600662] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.601191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.601191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.601191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.601191] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.601312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.601312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.601495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.601495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.601587] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.604052] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8eb7a60-f68d-4721-a979-2ed5cc95172e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.604883] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8eb7a60-f68d-4721-a979-2ed5cc95172e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.604883] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8eb7a60-f68d-4721-a979-2ed5cc95172e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.608323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8eb7a60-f68d-4721-a979-2ed5cc95172e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.608420] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8eb7a60-f68d-4721-a979-2ed5cc95172e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.672571] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870: rpc.has_security_group_logging(os_id): False [ 690.690470] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.690619] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.690691] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.690902] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.691060] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.691316] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.691417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.694964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.694964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.694964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.694964] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 is going to be created. [ 690.751887] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.752063] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.752140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.752351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.752534] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.765652] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 in Status: IN_PROGRESS for 2s [ 691.110641] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.111877] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.111953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.112422] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8eb7a60-f68d-4721-a979-2ed5cc95172e with status ACTIVE [ 691.112422] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.112422] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.112422] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.112614] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.113164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.113164] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.113164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.113164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.113164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.113337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.113477] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.113574] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.113846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.113846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.113846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.113950] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8eb7a60-f68d-4721-a979-2ed5cc95172e is going to be updated. [ 691.141769] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.141878] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.142621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.142621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.142621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.142621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8eb7a60-f68d-4721-a979-2ed5cc95172e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.182376] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 in Status: SUCCESS [ 691.182376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.616832] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.122369] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.122369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.122369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.122369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.122369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.122369] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 is going to be created. [ 692.142750] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.142932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.143038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.143721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.143721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.151657] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: UNINITIALIZED for 2s [ 692.777278] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 in Status: SUCCESS [ 692.777591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.163578] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: SUCCESS [ 694.163964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.163964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.164188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.164379] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.164496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.164565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.165463] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.165614] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.166150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.166150] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.674352] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.674701] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.675095] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.675437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.675755] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.675952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.676073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.676293] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.676392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.676492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.676693] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.676798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.676862] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.677086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.677245] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.677377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.677449] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.677597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.677677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.677760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.677850] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.180643] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13d987c8-57de-4cf5-acd3-eb580bd10337: rpc.has_security_group_logging(os_id): False [ 695.198312] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.198568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.198568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.198720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.198809] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.199506] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.199506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.199506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.199506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.199506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.199777] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.199777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.199777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.199866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.199893] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.201192] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.201192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.201192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.201192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.201192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.201192] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 is going to be created. [ 695.255807] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.255807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.256139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.256139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.256729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.272438] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: IN_PROGRESS for 2s [ 695.603017] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 695.603017] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 695.938868] env[69499]: INFO networking_nsxv3.common.synchronization [req-31b3ba29-7aef-472a-a22d-2f0e895ce5e3 req-03d4bb90-e9b6-457e-83b3-dc7b815142e8 tempest-ServerGroupTestJSON-377625122 tempest-ServerGroupTestJSON-377625122-project-member] Enqueued Resource ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 with Priority: HIGHEST for action security_group_members [ 695.939397] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 with Priority: HIGHEST for action security_group_members [ 695.939675] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-66a8ff79-7c57-42b0-afcb-f254b5d02311 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.940421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.940544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.941229] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.941449] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.941563] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.941630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.941791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.941881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.941976] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66a8ff79-7c57-42b0-afcb-f254b5d02311',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.079890] env[69499]: INFO networking_nsxv3.common.synchronization [req-87e86107-1f6f-4de1-b6af-50fdf6939792 req-3e0ee07b-3bb9-44ba-9dfb-e50f87aeef14 tempest-DeleteServersAdminTestJSON-760663801 tempest-DeleteServersAdminTestJSON-760663801-project-member] Enqueued Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_members [ 696.080475] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_members [ 696.080787] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.080913] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.080987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.081308] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.081367] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.081429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.081496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.081644] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.081729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.081819] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.426911] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.427619] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.427619] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.427619] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.428208] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.428208] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.428607] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.430899] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.431673] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.431673] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.431673] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.431673] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.431673] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.431673] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.431911] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.431911] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.446271] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.446417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.446490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.446684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.446789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.446976] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.447087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.447150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.447308] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.447538] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.447538] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 is going to be updated. [ 696.450116] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.450339] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 696.450490] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.450727] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.451505] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-f7f19f45-9bf5-49e3-b479-f909cd919d65 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.452200] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-f7f19f45-9bf5-49e3-b479-f909cd919d65" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.452200] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-f7f19f45-9bf5-49e3-b479-f909cd919d65" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.453528] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-f7f19f45-9bf5-49e3-b479-f909cd919d65" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.453691] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7f19f45-9bf5-49e3-b479-f909cd919d65',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.462199] env[69499]: INFO networking_nsxv3.common.synchronization [None req-20f43944-f50e-42f1-8f2c-64140802349c None None] Enqueued Resource ID: 1659d2aa-9ea0-4c4f-8a7a-cb05c6793660 with Priority: HIGHEST for action port [ 696.462464] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1659d2aa-9ea0-4c4f-8a7a-cb05c6793660 with Priority: HIGHEST for action port [ 696.463020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-1659d2aa-9ea0-4c4f-8a7a-cb05c6793660 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.463165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1659d2aa-9ea0-4c4f-8a7a-cb05c6793660" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.463228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1659d2aa-9ea0-4c4f-8a7a-cb05c6793660" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.463468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1659d2aa-9ea0-4c4f-8a7a-cb05c6793660" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.463549] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1659d2aa-9ea0-4c4f-8a7a-cb05c6793660',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.476861] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.477033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.477119] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.477303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.477484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.486984] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 in Status: IN_PROGRESS for 2s [ 696.705184] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.705377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.705452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.705595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.705696] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.705858] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.706024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.706024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.706490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.706490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.706490] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 is going to be updated. [ 696.732571] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.732739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.732810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.733172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.733172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.742098] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: IN_PROGRESS for 2s [ 696.958212] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.958212] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.958212] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.958212] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.958212] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.958212] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port f7f19f45-9bf5-49e3-b479-f909cd919d65 not found, creating... [ 696.958212] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.958212] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.958212] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.958212] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.958212] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.958856] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.963163] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.963163] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.963163] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.963163] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.963163] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: f7f19f45-9bf5-49e3-b479-f909cd919d65 is going to be created. [ 696.966293] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1659d2aa-9ea0-4c4f-8a7a-cb05c6793660 [ 696.966593] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.966716] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.966778] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.967136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.967225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.967306] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1659d2aa-9ea0-4c4f-8a7a-cb05c6793660 already deleted. [ 696.967904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1659d2aa-9ea0-4c4f-8a7a-cb05c6793660" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.984163] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.984163] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.984163] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.984163] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.984163] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.984163] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-f7f19f45-9bf5-49e3-b479-f909cd919d65" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.284159] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: SUCCESS [ 697.284442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.651645] env[69499]: INFO networking_nsxv3.common.synchronization [None req-b2a855d9-9fb8-484c-97e4-af1a345b29c2 tempest-ServersTestJSON-1975233753 tempest-ServersTestJSON-1975233753-project-member] Enqueued Resource ID: ffce52a9-70af-448f-a2c4-9791dde804d4 with Priority: HIGHEST for action security_group_rules [ 697.652247] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffce52a9-70af-448f-a2c4-9791dde804d4 with Priority: HIGHEST for action security_group_rules [ 697.652968] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffce52a9-70af-448f-a2c4-9791dde804d4 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.653106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.656179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.656179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.656179] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffce52a9-70af-448f-a2c4-9791dde804d4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.810888] env[69499]: INFO networking_nsxv3.common.synchronization [None req-c7f5716c-9287-4012-b321-4448b9a80d61 tempest-ServersTestJSON-1975233753 tempest-ServersTestJSON-1975233753-project-member] Enqueued Resource ID: ffce52a9-70af-448f-a2c4-9791dde804d4 with Priority: HIGHEST for action security_group_rules [ 697.813081] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffce52a9-70af-448f-a2c4-9791dde804d4 with Priority: HIGHEST for action security_group_rules [ 697.813846] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffce52a9-70af-448f-a2c4-9791dde804d4 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.814352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.833732] env[69499]: INFO networking_nsxv3.common.synchronization [req-87e86107-1f6f-4de1-b6af-50fdf6939792 req-d9a4ee14-0bf6-45cf-8931-24994cff9ebd service nova] Enqueued Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_rules [ 697.833732] env[69499]: INFO networking_nsxv3.common.synchronization [req-87e86107-1f6f-4de1-b6af-50fdf6939792 req-d9a4ee14-0bf6-45cf-8931-24994cff9ebd service nova] Enqueued Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_members [ 697.833732] env[69499]: INFO networking_nsxv3.common.synchronization [req-87e86107-1f6f-4de1-b6af-50fdf6939792 req-d9a4ee14-0bf6-45cf-8931-24994cff9ebd service nova] Enqueued Resource ID: f7f19f45-9bf5-49e3-b479-f909cd919d65 with Priority: HIGHEST for action port [ 697.833732] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_rules [ 697.833732] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_members [ 697.833732] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7f19f45-9bf5-49e3-b479-f909cd919d65 with Priority: HIGHEST for action port [ 697.834269] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.834544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.834733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.835075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.837823] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.837823] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.837823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.837823] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7f19f45-9bf5-49e3-b479-f909cd919d65 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.837823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7f19f45-9bf5-49e3-b479-f909cd919d65" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.837823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7f19f45-9bf5-49e3-b479-f909cd919d65" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.837823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7f19f45-9bf5-49e3-b479-f909cd919d65" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.837823] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7f19f45-9bf5-49e3-b479-f909cd919d65',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.181267] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.181446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.181504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.181984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.181984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.181984] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffce52a9-70af-448f-a2c4-9791dde804d4 already deleted. [ 698.181984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.182189] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.182231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.182313] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffce52a9-70af-448f-a2c4-9791dde804d4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.338748] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.338945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.340421] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7f19f45-9bf5-49e3-b479-f909cd919d65 with status ACTIVE [ 698.340421] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.340573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.340573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.340754] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.340839] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.341015] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.341116] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.341172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.341355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.341436] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.341582] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.341672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.341721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.341857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.341929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.342019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7f19f45-9bf5-49e3-b479-f909cd919d65 is going to be updated. [ 698.368652] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.368898] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.368947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.369255] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.369416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.369623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7f19f45-9bf5-49e3-b479-f909cd919d65" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.503710] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 in Status: SUCCESS [ 698.503710] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 deletion is rescheduled due to dependency. [ 698.503710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.704539] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.704953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.704953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.704953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.705091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.705234] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffce52a9-70af-448f-a2c4-9791dde804d4 already deleted. [ 698.705373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.750873] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: SUCCESS [ 698.751020] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 deletion is rescheduled due to dependency. [ 698.751063] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.751201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.751461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.751662] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.751781] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.751845] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.752035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.752147] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.752242] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.031593] env[69499]: INFO networking_nsxv3.common.synchronization [None req-dcde3798-09f6-42a3-b6b4-a656ae01d03b None None] Enqueued Resource ID: 751bfcfe-cf55-42b1-b9e3-2536ed14f473 with Priority: HIGHEST for action port [ 699.031970] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751bfcfe-cf55-42b1-b9e3-2536ed14f473 with Priority: HIGHEST for action port [ 699.032295] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-751bfcfe-cf55-42b1-b9e3-2536ed14f473 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.032450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-751bfcfe-cf55-42b1-b9e3-2536ed14f473" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.032505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-751bfcfe-cf55-42b1-b9e3-2536ed14f473" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.034154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-751bfcfe-cf55-42b1-b9e3-2536ed14f473" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.034154] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('751bfcfe-cf55-42b1-b9e3-2536ed14f473',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.054829] env[69499]: INFO networking_nsxv3.common.synchronization [req-3c9b2aee-20cb-40f9-95d0-7e68a669de99 req-3b78ce45-4b91-4641-849a-3204e02115fe tempest-ListImageFiltersTestJSON-1801888174 tempest-ListImageFiltersTestJSON-1801888174-project-member] Enqueued Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_members [ 699.055333] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_members [ 699.055622] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba52dd6-05d0-4283-ba0e-107ad8c10157 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.055739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.055796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.056620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.056828] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.056935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.057032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.057209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.057292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.057383] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.257198] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.358023] env[69499]: INFO networking_nsxv3.common.synchronization [req-cc7c93dd-60ca-4778-9011-da0e0046a79e req-d68d11d7-2603-4865-a6e3-2719b9cb9e43 tempest-ImagesOneServerTestJSON-342013829 tempest-ImagesOneServerTestJSON-342013829-project-member] Enqueued Resource ID: f140365e-2848-4938-ba34-06e4b21ec256 with Priority: HIGHEST for action security_group_members [ 699.358023] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f140365e-2848-4938-ba34-06e4b21ec256 with Priority: HIGHEST for action security_group_members [ 699.358023] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f140365e-2848-4938-ba34-06e4b21ec256 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.358023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.358023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.358402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.358402] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.358402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.358593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.358593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.358683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.358730] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f140365e-2848-4938-ba34-06e4b21ec256',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.537938] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 751bfcfe-cf55-42b1-b9e3-2536ed14f473 [ 699.538228] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.538367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.538440] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.538656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.538747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.538848] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:751bfcfe-cf55-42b1-b9e3-2536ed14f473 already deleted. [ 699.538928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-751bfcfe-cf55-42b1-b9e3-2536ed14f473" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.563326] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.761495] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.863023] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.863023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.863023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.863023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.863023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.863349] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.863349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.863349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.863514] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.863585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.863669] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f140365e-2848-4938-ba34-06e4b21ec256 is going to be updated. [ 699.894359] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.894528] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.894600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.894858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.895092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.904203] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f140365e-2848-4938-ba34-06e4b21ec256 in Status: IN_PROGRESS for 2s [ 700.066018] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.106056] env[69499]: INFO networking_nsxv3.common.synchronization [req-763191b0-5360-471e-ae6f-9f62ae282853 req-4b9cf39c-6321-46c7-8e74-e98813fccb05 tempest-AttachVolumeTestJSON-2079313698 tempest-AttachVolumeTestJSON-2079313698-project-member] Enqueued Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGHEST for action security_group_members [ 700.106056] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGHEST for action security_group_members [ 700.109065] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1159257b-8ed6-4ac4-9971-8ad543ef43f9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.109065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.109065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.109065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.109065] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.109065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.109065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.109065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.109065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.109065] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1159257b-8ed6-4ac4-9971-8ad543ef43f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.264057] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.264860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.264860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.264860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.264860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.264860] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 is going to be updated. [ 700.296310] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.296481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.296534] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.297351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.297351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.309662] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: IN_PROGRESS for 2s [ 700.548118] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.548118] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-786" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.548118] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-786" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.548118] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-786" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.548355] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.548355] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.550745] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.550745] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.550745] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.551555] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.551555] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.551555] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.551555] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.551886] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.552113] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.552429] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.569916] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.570111] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 700.570268] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.570451] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-786" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.570780] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-538c6076-4909-4194-ace5-9c235beb0a18 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.571093] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-538c6076-4909-4194-ace5-9c235beb0a18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.571093] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-538c6076-4909-4194-ace5-9c235beb0a18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.571448] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-538c6076-4909-4194-ace5-9c235beb0a18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.571593] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('538c6076-4909-4194-ace5-9c235beb0a18',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.575047] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.575365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.575365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.575462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.575542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.575634] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 is going to be updated. [ 700.600153] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.600305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.600378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.600578] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.600718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.608899] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: IN_PROGRESS for 2s [ 700.611431] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.611431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.611521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.611695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.611833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.611967] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.612094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.612155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.612309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.612382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.612463] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 already deleted. [ 700.612542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.074699] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.074996] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.075076] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.075372] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.075526] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.075686] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 538c6076-4909-4194-ace5-9c235beb0a18 not found, creating... [ 701.075948] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.076123] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.076243] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.076459] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.076597] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.076877] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.077063] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.077189] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.077396] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.077530] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.077668] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 538c6076-4909-4194-ace5-9c235beb0a18 is going to be created. [ 701.096777] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.097018] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.097138] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.097407] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.097630] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.097849] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-538c6076-4909-4194-ace5-9c235beb0a18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.915097] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f140365e-2848-4938-ba34-06e4b21ec256 in Status: SUCCESS [ 701.915233] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f140365e-2848-4938-ba34-06e4b21ec256 deletion is rescheduled due to dependency. [ 701.915394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f140365e-2848-4938-ba34-06e4b21ec256" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.935471] env[69499]: INFO networking_nsxv3.common.synchronization [req-763191b0-5360-471e-ae6f-9f62ae282853 req-b7b93aa7-2063-4162-87bf-0cad3f781eed service nova] Enqueued Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGHEST for action security_group_rules [ 701.935471] env[69499]: INFO networking_nsxv3.common.synchronization [req-763191b0-5360-471e-ae6f-9f62ae282853 req-b7b93aa7-2063-4162-87bf-0cad3f781eed service nova] Enqueued Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGHEST for action security_group_members [ 701.940381] env[69499]: INFO networking_nsxv3.common.synchronization [req-763191b0-5360-471e-ae6f-9f62ae282853 req-b7b93aa7-2063-4162-87bf-0cad3f781eed service nova] Enqueued Resource ID: 538c6076-4909-4194-ace5-9c235beb0a18 with Priority: HIGHEST for action port [ 701.940381] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGHEST for action security_group_rules [ 701.940381] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGHEST for action security_group_members [ 701.940381] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538c6076-4909-4194-ace5-9c235beb0a18 with Priority: HIGHEST for action port [ 701.940381] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.940381] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.940381] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.940381] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.940381] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1159257b-8ed6-4ac4-9971-8ad543ef43f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.940381] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1159257b-8ed6-4ac4-9971-8ad543ef43f9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.940381] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.940381] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.940381] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.940854] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.940854] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.940854] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.940854] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.941035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.941035] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1159257b-8ed6-4ac4-9971-8ad543ef43f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.943958] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-538c6076-4909-4194-ace5-9c235beb0a18 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.943958] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-538c6076-4909-4194-ace5-9c235beb0a18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.943958] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-538c6076-4909-4194-ace5-9c235beb0a18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.943958] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-538c6076-4909-4194-ace5-9c235beb0a18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.944235] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('538c6076-4909-4194-ace5-9c235beb0a18',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.316823] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: SUCCESS [ 702.317136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.317280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.317492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.317683] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.317803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.317859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.318041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.318127] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.318207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.318387] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.446110] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1159257b-8ed6-4ac4-9971-8ad543ef43f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.447277] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1159257b-8ed6-4ac4-9971-8ad543ef43f9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.447390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.448922] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 538c6076-4909-4194-ace5-9c235beb0a18 with status ACTIVE [ 702.449027] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.449140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.449294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.449498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.449588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.449761] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.449872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.449925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.450076] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.450155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.450310] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.450397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.450456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.450593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.450665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.450746] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 538c6076-4909-4194-ace5-9c235beb0a18 is going to be updated. [ 702.469995] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.470200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.470326] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.470451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.470573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.470708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-538c6076-4909-4194-ace5-9c235beb0a18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.628545] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: SUCCESS [ 702.628710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.821231] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.821343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.821466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.821647] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.821857] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.821978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.822100] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.822250] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.822387] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.822473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.822661] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.822764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.822829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.823031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.823209] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.823319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.823395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.823576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.823677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.823780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.823888] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.948951] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1159257b-8ed6-4ac4-9971-8ad543ef43f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.326011] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e860a997-ace0-45f9-bc64-b9fbf2d50c35: rpc.has_security_group_logging(os_id): False [ 703.344015] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.344015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.344015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.344376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.344376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.344544] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.344706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.344810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.345118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.345252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.345569] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.345740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.345837] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.346078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.346204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.346483] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.346622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.346712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.346918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.347120] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.347260] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 is going to be updated. [ 703.410837] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.411309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.412462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.412462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.412462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.424708] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: IN_PROGRESS for 2s [ 703.452173] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.452327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.452402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.452620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.452745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.452910] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 is going to be created. [ 703.498020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.498020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.498020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.498020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.498020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.517148] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 in Status: UNINITIALIZED for 2s [ 703.764133] env[69499]: INFO networking_nsxv3.common.synchronization [req-669cf081-fcf5-4ad2-90eb-6b229ac6bd51 req-e1ea3a64-e002-4681-a5ae-441771f7b2b3 tempest-ImagesTestJSON-490670806 tempest-ImagesTestJSON-490670806-project-member] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 703.764133] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 703.764133] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.764133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.764133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.764647] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.764948] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.765717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.765901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.766198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.766525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.766754] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.168927] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.169218] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.169393] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.169751] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.170210] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.170479] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.170691] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.171030] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.171294] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.171605] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.171811] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.172029] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.172220] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.172420] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.172613] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.172836] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.191444] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.191721] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 704.191959] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.192261] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.192690] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-84704b16-d8b3-4565-a384-c8fe526200cd taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.192926] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-84704b16-d8b3-4565-a384-c8fe526200cd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.193121] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-84704b16-d8b3-4565-a384-c8fe526200cd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.193669] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-84704b16-d8b3-4565-a384-c8fe526200cd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.193735] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84704b16-d8b3-4565-a384-c8fe526200cd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.269424] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.269827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.269827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.269928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.269962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.270158] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.270256] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.270320] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.270469] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.270549] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.270636] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 704.296104] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.296288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.296338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.296539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.296680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.304510] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 704.697442] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.697778] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.697778] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.698074] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.698249] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.698434] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 84704b16-d8b3-4565-a384-c8fe526200cd not found, creating... [ 704.698727] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.698856] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.698967] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.699219] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.699602] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.699679] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.699834] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.699977] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.700204] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.700343] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.700484] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 84704b16-d8b3-4565-a384-c8fe526200cd is going to be created. [ 704.721416] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.721416] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.721416] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.721416] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.721416] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.721416] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-84704b16-d8b3-4565-a384-c8fe526200cd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.438665] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: SUCCESS [ 705.438858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.511345] env[69499]: INFO networking_nsxv3.common.synchronization [req-669cf081-fcf5-4ad2-90eb-6b229ac6bd51 req-540cb04b-8180-4477-9a91-17228f13e548 service nova] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_rules [ 705.511516] env[69499]: INFO networking_nsxv3.common.synchronization [req-669cf081-fcf5-4ad2-90eb-6b229ac6bd51 req-540cb04b-8180-4477-9a91-17228f13e548 service nova] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 705.511654] env[69499]: INFO networking_nsxv3.common.synchronization [req-669cf081-fcf5-4ad2-90eb-6b229ac6bd51 req-540cb04b-8180-4477-9a91-17228f13e548 service nova] Enqueued Resource ID: 84704b16-d8b3-4565-a384-c8fe526200cd with Priority: HIGHEST for action port [ 705.511882] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_rules [ 705.512029] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 705.512116] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84704b16-d8b3-4565-a384-c8fe526200cd with Priority: HIGHEST for action port [ 705.512637] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.512762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.512833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.513206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.513331] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.514229] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.514364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.514585] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-84704b16-d8b3-4565-a384-c8fe526200cd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.514718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84704b16-d8b3-4565-a384-c8fe526200cd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.514803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84704b16-d8b3-4565-a384-c8fe526200cd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.515033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84704b16-d8b3-4565-a384-c8fe526200cd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.515136] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84704b16-d8b3-4565-a384-c8fe526200cd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.525450] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 in Status: SUCCESS [ 705.525712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.525873] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.526104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.526454] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.526576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.526644] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.526803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.526886] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.526977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.527132] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1159257b-8ed6-4ac4-9971-8ad543ef43f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.016692] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.017211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.017211] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84704b16-d8b3-4565-a384-c8fe526200cd with status ACTIVE [ 706.017342] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.017476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.017545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.017849] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.017900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.018049] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.018168] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.018238] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.018408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.018489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.018754] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.018852] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.018916] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.019081] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.019162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.019249] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84704b16-d8b3-4565-a384-c8fe526200cd is going to be updated. [ 706.030180] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1159257b-8ed6-4ac4-9971-8ad543ef43f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.039859] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.040051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.040143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.040360] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.040499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.040652] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84704b16-d8b3-4565-a384-c8fe526200cd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.317144] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 706.317144] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de deletion is rescheduled due to dependency. [ 706.317144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.317144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.317144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.317144] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.317144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.317144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.317144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.317144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.317144] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.531920] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1159257b-8ed6-4ac4-9971-8ad543ef43f9: rpc.has_security_group_logging(os_id): False [ 706.548528] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.548740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.548740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.548943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.549153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.549457] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.549559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.549626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.549789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.549965] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.549965] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 is going to be created. [ 706.604756] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.605030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.605030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.605361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.605750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.614626] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 in Status: IN_PROGRESS for 2s [ 706.821538] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.929023] env[69499]: INFO networking_nsxv3.common.synchronization [None req-b9286160-9453-431f-9b46-0d8de1f5f0c8 tempest-MigrationsAdminTest-725814107 tempest-MigrationsAdminTest-725814107-project-member] Enqueued Resource ID: 4a3596c3-a7e2-4764-914b-4014b07e8bce with Priority: HIGHEST for action security_group_rules [ 706.930156] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a3596c3-a7e2-4764-914b-4014b07e8bce with Priority: HIGHEST for action security_group_rules [ 706.931150] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a3596c3-a7e2-4764-914b-4014b07e8bce taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.931150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a3596c3-a7e2-4764-914b-4014b07e8bce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.931150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a3596c3-a7e2-4764-914b-4014b07e8bce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.932102] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a3596c3-a7e2-4764-914b-4014b07e8bce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.933026] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a3596c3-a7e2-4764-914b-4014b07e8bce',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.017101] env[69499]: INFO networking_nsxv3.common.synchronization [None req-59fe27cf-a5c8-48cd-aded-d85c2d2d84cd tempest-MigrationsAdminTest-725814107 tempest-MigrationsAdminTest-725814107-project-member] Enqueued Resource ID: 4a3596c3-a7e2-4764-914b-4014b07e8bce with Priority: HIGHEST for action security_group_rules [ 707.017765] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a3596c3-a7e2-4764-914b-4014b07e8bce with Priority: HIGHEST for action security_group_rules [ 707.017874] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a3596c3-a7e2-4764-914b-4014b07e8bce taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.018021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a3596c3-a7e2-4764-914b-4014b07e8bce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.323621] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.454480] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.454644] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.454710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.455046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.455205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.455364] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a3596c3-a7e2-4764-914b-4014b07e8bce already deleted. [ 707.455483] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a3596c3-a7e2-4764-914b-4014b07e8bce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.456081] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a3596c3-a7e2-4764-914b-4014b07e8bce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.456081] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a3596c3-a7e2-4764-914b-4014b07e8bce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.456081] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a3596c3-a7e2-4764-914b-4014b07e8bce',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.826421] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.826685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.826745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.827011] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.827189] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.827314] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 707.854099] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.854264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.854341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.854558] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.854705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.863517] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 707.975114] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.975288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.975348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.975553] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.975646] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.975747] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a3596c3-a7e2-4764-914b-4014b07e8bce already deleted. [ 707.975828] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a3596c3-a7e2-4764-914b-4014b07e8bce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.577642] env[69499]: INFO networking_nsxv3.common.synchronization [req-c7df9c67-3f4b-4662-bfe3-6d106785dbcb req-3fd229d6-36e4-4492-b303-4892b82da3ad tempest-DeleteServersAdminTestJSON-760663801 tempest-DeleteServersAdminTestJSON-760663801-project-member] Enqueued Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_members [ 708.578282] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGHEST for action security_group_members [ 708.578655] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.578794] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.578888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.579135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.579328] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.579445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.579519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.579725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.579792] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.579883] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.628502] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 in Status: SUCCESS [ 708.628977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.081696] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.081814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.081969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.082241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.082376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.082625] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.082760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.082847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.083043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.083174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.083544] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 is going to be updated. [ 709.091405] env[69499]: INFO networking_nsxv3.common.synchronization [req-4be52410-d272-464d-a636-0ad75765d1ce req-e1c5e6e2-94ef-47dc-8e2c-6b1cc52f7b85 tempest-ServersAdminNegativeTestJSON-242497510 tempest-ServersAdminNegativeTestJSON-242497510-project-member] Enqueued Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_members [ 709.091944] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_members [ 709.092311] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.092463] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.092555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.092815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.092996] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.093177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.093275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.093466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.093587] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.093702] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.111764] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.111764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.111764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.111764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.111764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.121257] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: IN_PROGRESS for 2s [ 709.468744] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.468744] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.468744] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.468744] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.469441] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.469441] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.469441] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.469441] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.469703] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.472034] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.472034] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.472034] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.472034] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.472034] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.472034] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.472034] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.489583] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.489756] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 709.489911] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.490131] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.490493] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-75d1fd44-e8cc-476c-97a0-a24da664e15e taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.490712] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-75d1fd44-e8cc-476c-97a0-a24da664e15e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.490810] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-75d1fd44-e8cc-476c-97a0-a24da664e15e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.491110] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-75d1fd44-e8cc-476c-97a0-a24da664e15e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.491254] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75d1fd44-e8cc-476c-97a0-a24da664e15e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.596590] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.596590] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.596590] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.596935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.596935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.597207] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.597345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.597444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.597623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.597713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.597802] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f00aea48-dae0-47aa-a96c-f017c0721f54 already deleted. [ 709.597927] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.874211] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 709.874436] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.874617] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.874848] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.875194] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.875357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.875466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.875584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.875672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.875763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.875856] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.995703] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.995951] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.996150] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.996486] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.996655] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.996884] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 75d1fd44-e8cc-476c-97a0-a24da664e15e not found, creating... [ 709.997134] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.997317] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.997429] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.997686] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.997830] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.998332] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.998510] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.998629] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.998886] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.999042] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.999229] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 75d1fd44-e8cc-476c-97a0-a24da664e15e is going to be created. [ 710.021161] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.021480] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.021685] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.022092] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.022446] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.022773] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-75d1fd44-e8cc-476c-97a0-a24da664e15e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.378569] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.378691] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.378770] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.378978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.379171] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.379280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.379346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.379505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.379593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.379682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.379853] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.379920] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.379971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.380125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.380264] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.380355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.380436] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.380600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.380678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.380760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.380846] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.851806] env[69499]: INFO networking_nsxv3.common.synchronization [req-4be52410-d272-464d-a636-0ad75765d1ce req-1edae495-281f-45cf-abcf-7237bf88a7ee service nova] Enqueued Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_rules [ 710.852138] env[69499]: INFO networking_nsxv3.common.synchronization [req-4be52410-d272-464d-a636-0ad75765d1ce req-1edae495-281f-45cf-abcf-7237bf88a7ee service nova] Enqueued Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_members [ 710.853662] env[69499]: INFO networking_nsxv3.common.synchronization [req-4be52410-d272-464d-a636-0ad75765d1ce req-1edae495-281f-45cf-abcf-7237bf88a7ee service nova] Enqueued Resource ID: 75d1fd44-e8cc-476c-97a0-a24da664e15e with Priority: HIGHEST for action port [ 710.853662] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_rules [ 710.853662] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_members [ 710.853662] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75d1fd44-e8cc-476c-97a0-a24da664e15e with Priority: HIGHEST for action port [ 710.854925] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.855104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.855305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.855446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.855542] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.856480] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.856579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.856618] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.856785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.856917] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.857016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.857116] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.857261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.857349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.857439] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.858206] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-75d1fd44-e8cc-476c-97a0-a24da664e15e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.858319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75d1fd44-e8cc-476c-97a0-a24da664e15e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.858388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75d1fd44-e8cc-476c-97a0-a24da664e15e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.858538] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75d1fd44-e8cc-476c-97a0-a24da664e15e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.858613] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75d1fd44-e8cc-476c-97a0-a24da664e15e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.882513] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 137495f6-8f3c-475d-b71c-88971c3781de: rpc.has_security_group_logging(os_id): False [ 710.901975] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.902230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.902319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.902571] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.902696] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.902950] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.903088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.903156] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.903352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.903457] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.903675] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.903783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.903867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.904045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.904125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.904348] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.904454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.904526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.904672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.904746] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.904831] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 710.969979] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.969979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.969979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.970262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.970262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.984321] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 711.130773] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: IN_PROGRESS for 4s [ 711.362133] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.362133] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.362504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.362504] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75d1fd44-e8cc-476c-97a0-a24da664e15e with status ACTIVE [ 711.362504] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.362696] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.362696] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.363074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.363074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.363246] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.363351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.363423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.363579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.363650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.372025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.372025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.372025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.372025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.372025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.372025] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75d1fd44-e8cc-476c-97a0-a24da664e15e is going to be updated. [ 711.394777] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.394922] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.394994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.395291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.395451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.395607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75d1fd44-e8cc-476c-97a0-a24da664e15e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.711878] env[69499]: INFO networking_nsxv3.common.synchronization [req-02a3700e-4d94-4ff0-b5e5-8137e79a7fa7 req-69180c3d-9ce0-4d98-a5a1-6aa292bd1193 tempest-AttachVolumeShelveTestJSON-1831532901 tempest-AttachVolumeShelveTestJSON-1831532901-project-member] Enqueued Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_members [ 711.712407] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_members [ 711.712693] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8593ab1f-869e-4abc-aa58-bb57de585b7e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.712807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.712870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.714261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.714454] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.714562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.714628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.714811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.715343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.715463] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.786898] env[69499]: INFO networking_nsxv3.common.synchronization [req-f884aff2-1c34-434b-9db8-cb5d91bff939 req-bcf8ccd7-9f1f-4c32-85aa-ea14bc956ec0 tempest-ImagesOneServerNegativeTestJSON-1949881093 tempest-ImagesOneServerNegativeTestJSON-1949881093-project-member] Enqueued Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 711.787552] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 711.787859] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.787984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.788803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.789039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.789214] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.789324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.789439] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.791231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.791336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.791457] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.874622] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.158094] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-490 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.158263] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.158297] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.158631] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.158893] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.160101] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.160262] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.160513] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.160668] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.160876] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.160991] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.161114] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.161220] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.161528] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.161528] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.161632] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.180208] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.180385] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 712.180781] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.181011] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.181351] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-25575976-0a88-43e5-ad3c-f04c3e76efc6 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.181830] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.181961] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.182297] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.182441] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25575976-0a88-43e5-ad3c-f04c3e76efc6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.219172] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.219351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.219424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.219668] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.219759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.219977] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.220824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.220824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.220824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.220824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.220824] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e already deleted. [ 712.220824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.294653] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.294653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.294653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.294653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.294653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.294653] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.294653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.294653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.294653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.294653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.294653] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 is going to be updated. [ 712.320576] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.320724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.320830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.321019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.321156] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.333912] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: IN_PROGRESS for 2s [ 712.377538] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.377748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.377845] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.378133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.378741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.378741] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f00aea48-dae0-47aa-a96c-f017c0721f54 is going to be created. [ 712.406432] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.406432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.406432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.406906] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.406906] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.419024] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: UNINITIALIZED for 2s [ 712.685341] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.685527] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.685653] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.685937] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.686119] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.686275] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 25575976-0a88-43e5-ad3c-f04c3e76efc6 not found, creating... [ 712.686527] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.686697] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.686794] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.687025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.687221] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.687508] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.687675] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.687775] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.687968] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.688115] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.688324] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 25575976-0a88-43e5-ad3c-f04c3e76efc6 is going to be created. [ 712.714205] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.714437] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.714566] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.714838] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.715097] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.715866] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.010712] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 713.011067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.138939] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 in Status: SUCCESS [ 713.140223] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 deletion is rescheduled due to dependency. [ 713.140344] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.445970] env[69499]: INFO networking_nsxv3.common.synchronization [req-02a3700e-4d94-4ff0-b5e5-8137e79a7fa7 req-841cd968-863e-435e-baec-33a071e4876a service nova] Enqueued Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_rules [ 713.446274] env[69499]: INFO networking_nsxv3.common.synchronization [req-02a3700e-4d94-4ff0-b5e5-8137e79a7fa7 req-841cd968-863e-435e-baec-33a071e4876a service nova] Enqueued Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_members [ 713.446486] env[69499]: INFO networking_nsxv3.common.synchronization [req-02a3700e-4d94-4ff0-b5e5-8137e79a7fa7 req-841cd968-863e-435e-baec-33a071e4876a service nova] Enqueued Resource ID: 25575976-0a88-43e5-ad3c-f04c3e76efc6 with Priority: HIGHEST for action port [ 713.447389] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_rules [ 713.447504] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_members [ 713.447648] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25575976-0a88-43e5-ad3c-f04c3e76efc6 with Priority: HIGHEST for action port [ 713.448044] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8593ab1f-869e-4abc-aa58-bb57de585b7e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.448206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.448310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.448606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.448726] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.449615] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8593ab1f-869e-4abc-aa58-bb57de585b7e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.449747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.449828] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.450014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.450163] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.450407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.450407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.450491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.450525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.450622] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.451548] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-25575976-0a88-43e5-ad3c-f04c3e76efc6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.451548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.451548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.451914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.451914] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25575976-0a88-43e5-ad3c-f04c3e76efc6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.953635] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.954615] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25575976-0a88-43e5-ad3c-f04c3e76efc6 with status ACTIVE [ 713.954863] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.954999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.955081] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.955315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.955411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.955596] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.955923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.955923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.955923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.956067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.956185] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.956287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.956353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.956497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.956573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.956658] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25575976-0a88-43e5-ad3c-f04c3e76efc6 is going to be updated. [ 713.957795] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8593ab1f-869e-4abc-aa58-bb57de585b7e taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.957920] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.976946] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.977118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.977183] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.977382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.977517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.977669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.343844] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: SUCCESS [ 714.343844] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 deletion is rescheduled due to dependency. [ 714.343844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.354105] env[69499]: INFO networking_nsxv3.common.synchronization [req-fa0fc78d-f807-424f-942d-433b99501882 req-ac7699d5-7b2a-415f-a062-35434dbc4e54 tempest-ServersTestFqdnHostnames-969656061 tempest-ServersTestFqdnHostnames-969656061-project-member] Enqueued Resource ID: a240c519-0037-4bca-bd0c-b35068bcd700 with Priority: HIGHEST for action security_group_members [ 714.354105] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a240c519-0037-4bca-bd0c-b35068bcd700 with Priority: HIGHEST for action security_group_members [ 714.354105] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a240c519-0037-4bca-bd0c-b35068bcd700 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.354105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.354105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.354424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.354729] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.355052] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.355207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.355451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.355625] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.355796] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a240c519-0037-4bca-bd0c-b35068bcd700',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.428123] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: SUCCESS [ 714.428372] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.428537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.428756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.428933] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.429060] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.429119] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.429267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.429348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.429441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.429549] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.459453] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.738764] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.738970] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-628" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.739110] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-628" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.739473] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-628" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.739747] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.739909] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.740053] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.740578] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.740741] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.740951] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 714.741083] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.741194] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.741303] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.741412] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 714.741516] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.741648] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.758360] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.758530] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 714.758640] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.758806] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-628" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.759101] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-16357eca-9514-4c8d-be8b-f9ed45a876a1 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.759298] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-16357eca-9514-4c8d-be8b-f9ed45a876a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.759429] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-16357eca-9514-4c8d-be8b-f9ed45a876a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.759713] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-16357eca-9514-4c8d-be8b-f9ed45a876a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.759851] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16357eca-9514-4c8d-be8b-f9ed45a876a1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.857705] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.857855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.857924] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.858181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.858290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.858501] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.858601] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.858663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.858818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.858894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.858978] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a240c519-0037-4bca-bd0c-b35068bcd700 already deleted. [ 714.859069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.932889] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.932889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.932889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.932889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.932889] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.932889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.933312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.933312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.933312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.933312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.933428] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.933558] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.933704] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.941209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.941209] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.941209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.941209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.941209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.941209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.941209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.941209] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.960851] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.961810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.961810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.961810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.961810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.962019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e is going to be created. [ 714.983797] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.983945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.984057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.984227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.984382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.992814] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e in Status: UNINITIALIZED for 2s [ 715.261776] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.261998] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.262131] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.262405] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.262551] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.262705] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 16357eca-9514-4c8d-be8b-f9ed45a876a1 not found, creating... [ 715.262956] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.263124] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.263242] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.263446] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.263581] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.263893] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.263993] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.264123] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.264325] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.264453] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.264589] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 16357eca-9514-4c8d-be8b-f9ed45a876a1 is going to be created. [ 715.283057] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.283280] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.283393] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.283676] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.283900] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.284129] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-16357eca-9514-4c8d-be8b-f9ed45a876a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.443060] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f00aea48-dae0-47aa-a96c-f017c0721f54: rpc.has_security_group_logging(os_id): False [ 715.463268] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.463268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.463268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.463268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.463268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.463268] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.463268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.463268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.463268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.463268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.463268] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.463268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.463268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.463268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.463268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.463762] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.463762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.463762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.463762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.463762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.463762] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f00aea48-dae0-47aa-a96c-f017c0721f54 is going to be created. [ 715.654620] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.654838] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.654838] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.655111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.655312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.676278] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: IN_PROGRESS for 2s [ 716.019425] env[69499]: INFO networking_nsxv3.common.synchronization [req-fa0fc78d-f807-424f-942d-433b99501882 req-8f62bb1c-00f3-4160-b45e-ef52cbfd7b97 service nova] Enqueued Resource ID: a240c519-0037-4bca-bd0c-b35068bcd700 with Priority: HIGHEST for action security_group_rules [ 716.019678] env[69499]: INFO networking_nsxv3.common.synchronization [req-fa0fc78d-f807-424f-942d-433b99501882 req-8f62bb1c-00f3-4160-b45e-ef52cbfd7b97 service nova] Enqueued Resource ID: a240c519-0037-4bca-bd0c-b35068bcd700 with Priority: HIGHEST for action security_group_members [ 716.019825] env[69499]: INFO networking_nsxv3.common.synchronization [req-fa0fc78d-f807-424f-942d-433b99501882 req-8f62bb1c-00f3-4160-b45e-ef52cbfd7b97 service nova] Enqueued Resource ID: 16357eca-9514-4c8d-be8b-f9ed45a876a1 with Priority: HIGHEST for action port [ 716.020069] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a240c519-0037-4bca-bd0c-b35068bcd700 with Priority: HIGHEST for action security_group_rules [ 716.020197] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a240c519-0037-4bca-bd0c-b35068bcd700 with Priority: HIGHEST for action security_group_members [ 716.020293] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16357eca-9514-4c8d-be8b-f9ed45a876a1 with Priority: HIGHEST for action port [ 716.020814] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a240c519-0037-4bca-bd0c-b35068bcd700 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.020942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.021033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.021252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.021336] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a240c519-0037-4bca-bd0c-b35068bcd700',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.022130] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a240c519-0037-4bca-bd0c-b35068bcd700 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.022246] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.022313] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.022477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.022649] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.022749] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.022813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.022955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.023053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.023141] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a240c519-0037-4bca-bd0c-b35068bcd700',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.023836] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-16357eca-9514-4c8d-be8b-f9ed45a876a1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.023921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16357eca-9514-4c8d-be8b-f9ed45a876a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.023981] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16357eca-9514-4c8d-be8b-f9ed45a876a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.024173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16357eca-9514-4c8d-be8b-f9ed45a876a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.024255] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16357eca-9514-4c8d-be8b-f9ed45a876a1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.526114] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a240c519-0037-4bca-bd0c-b35068bcd700 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.526427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.527608] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16357eca-9514-4c8d-be8b-f9ed45a876a1 with status ACTIVE [ 716.527738] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.527853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.527919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.528206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.528309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.528484] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.528584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.528641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.528804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.528886] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.529081] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.529175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.529234] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.529374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.529444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.529529] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16357eca-9514-4c8d-be8b-f9ed45a876a1 is going to be updated. [ 716.530590] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a240c519-0037-4bca-bd0c-b35068bcd700',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.550754] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.550900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.550963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.551206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.551357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.551518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16357eca-9514-4c8d-be8b-f9ed45a876a1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.007612] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e in Status: SUCCESS [ 717.007612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.007612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.007612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.007612] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.007612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.007612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.007612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.007612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.007612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.007612] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.036346] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a240c519-0037-4bca-bd0c-b35068bcd700',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.510029] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.541762] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.542266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.542426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.542624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.542730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.542841] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a240c519-0037-4bca-bd0c-b35068bcd700 is going to be created. [ 717.565019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.565175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.565283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.565537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.565708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.573833] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a240c519-0037-4bca-bd0c-b35068bcd700 in Status: UNINITIALIZED for 2s [ 717.704420] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: SUCCESS [ 717.704420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.012794] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8593ab1f-869e-4abc-aa58-bb57de585b7e: rpc.has_security_group_logging(os_id): False [ 718.032158] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.032362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.032362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.032540] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.032682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.032909] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.033018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.033093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.033256] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.033337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.033426] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e is going to be created. [ 718.092790] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.092894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.092974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.093323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.093727] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.105314] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e in Status: IN_PROGRESS for 2s [ 719.584650] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a240c519-0037-4bca-bd0c-b35068bcd700 in Status: SUCCESS [ 719.585027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.585705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.585705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.585892] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.586089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.586194] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.586408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.586533] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.586672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.586792] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a240c519-0037-4bca-bd0c-b35068bcd700',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.088833] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a240c519-0037-4bca-bd0c-b35068bcd700',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.120066] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e in Status: SUCCESS [ 720.120066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.592326] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a240c519-0037-4bca-bd0c-b35068bcd700: rpc.has_security_group_logging(os_id): False [ 720.609158] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.612024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.612024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.612024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.612024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.612024] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.612024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.612024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.612024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.612024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.612024] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a240c519-0037-4bca-bd0c-b35068bcd700 is going to be created. [ 720.667046] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.667046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.667046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.667046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.667046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.680265] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a240c519-0037-4bca-bd0c-b35068bcd700 in Status: IN_PROGRESS for 2s [ 721.021372] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 721.021372] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 721.179645] env[69499]: INFO networking_nsxv3.common.synchronization [None req-3339cb04-2054-4c1e-89e6-debf45a741ab None None] Enqueued Resource ID: 53416d02-1734-461e-a321-172501b0dd09 with Priority: HIGHEST for action port [ 721.180377] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53416d02-1734-461e-a321-172501b0dd09 with Priority: HIGHEST for action port [ 721.181039] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-53416d02-1734-461e-a321-172501b0dd09 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.181175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53416d02-1734-461e-a321-172501b0dd09" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.181244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53416d02-1734-461e-a321-172501b0dd09" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.181505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53416d02-1734-461e-a321-172501b0dd09" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.181592] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53416d02-1734-461e-a321-172501b0dd09',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.684969] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53416d02-1734-461e-a321-172501b0dd09 [ 721.685214] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.685472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.685472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.685636] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.685692] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.685792] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53416d02-1734-461e-a321-172501b0dd09 already deleted. [ 721.685870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53416d02-1734-461e-a321-172501b0dd09" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.281196] env[69499]: INFO networking_nsxv3.common.synchronization [req-6a86a67c-8e54-4870-9b5e-36efa349c474 req-905a9672-eb26-41b7-b4bf-b41c4de5e47c tempest-ServersWithSpecificFlavorTestJSON-328556625 tempest-ServersWithSpecificFlavorTestJSON-328556625-project-member] Enqueued Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_members [ 722.281196] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_members [ 722.281196] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8579ac1e-c68a-42fa-957e-e205942d2fbc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.281196] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.281196] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.281196] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.281196] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.282651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.282784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.282979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.283097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.283203] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.489316] env[69499]: INFO networking_nsxv3.common.synchronization [req-25cec5e9-9999-44d7-87f5-6b4e9d530ad8 req-755d55d6-5b72-4546-97e3-cc97f0f488de tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 722.489803] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 722.491144] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.491488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.491717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.492098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.492462] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.492761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.492975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.494939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.494939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.494939] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.701918] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a240c519-0037-4bca-bd0c-b35068bcd700 in Status: SUCCESS [ 722.701918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.792214] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.792214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.792214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.792214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.792214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.792214] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.792214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.792214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.792214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.792214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.792214] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc is going to be updated. [ 722.832303] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.832303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.832303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.832499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.832568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.848380] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc in Status: IN_PROGRESS for 2s [ 722.996945] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.089054] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-142 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.089270] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-142" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.089414] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-142" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.089731] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-142" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.090018] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.091170] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.091295] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.091552] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.091749] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.091940] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.092071] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.092187] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.092300] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.092427] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.092518] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.092800] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.113243] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.113243] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 723.113243] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.113243] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-142" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.113243] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-b4ec4368-9767-4513-97e8-fd441a1aca50 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.113243] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.113243] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.113243] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.113243] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4ec4368-9767-4513-97e8-fd441a1aca50',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.481498] env[69499]: INFO networking_nsxv3.common.synchronization [None req-76a430fd-9b96-4a7c-9a44-ad050f2a9219 None None] Enqueued Resource ID: 9a282abd-ff89-4b2e-9b54-f933e63afbee with Priority: HIGHEST for action port [ 723.481498] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a282abd-ff89-4b2e-9b54-f933e63afbee with Priority: HIGHEST for action port [ 723.483631] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a282abd-ff89-4b2e-9b54-f933e63afbee taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.483631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a282abd-ff89-4b2e-9b54-f933e63afbee" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.483631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a282abd-ff89-4b2e-9b54-f933e63afbee" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.483631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a282abd-ff89-4b2e-9b54-f933e63afbee" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.483631] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a282abd-ff89-4b2e-9b54-f933e63afbee',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.499367] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.616224] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.616527] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.616676] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.616919] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.617915] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.617915] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port b4ec4368-9767-4513-97e8-fd441a1aca50 not found, creating... [ 723.618116] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.618116] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.618219] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.618457] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.618602] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.618887] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.619054] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.619293] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.619381] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.619862] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.620065] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: b4ec4368-9767-4513-97e8-fd441a1aca50 is going to be created. [ 723.641807] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.641807] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.641807] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.643636] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.643636] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.643636] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.990019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a282abd-ff89-4b2e-9b54-f933e63afbee [ 723.990019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.990019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.990019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.990019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.990019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.990019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a282abd-ff89-4b2e-9b54-f933e63afbee already deleted. [ 723.990019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a282abd-ff89-4b2e-9b54-f933e63afbee" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.003195] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.003316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.003316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.003544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.003642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.003758] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 724.036418] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.036418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.036418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.036418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.036418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.042849] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 724.794613] env[69499]: INFO networking_nsxv3.common.synchronization [req-25cec5e9-9999-44d7-87f5-6b4e9d530ad8 req-c0e801ea-a0cb-4ef4-a692-004771dfdbc7 service nova] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_rules [ 724.795307] env[69499]: INFO networking_nsxv3.common.synchronization [req-25cec5e9-9999-44d7-87f5-6b4e9d530ad8 req-c0e801ea-a0cb-4ef4-a692-004771dfdbc7 service nova] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 724.795882] env[69499]: INFO networking_nsxv3.common.synchronization [req-25cec5e9-9999-44d7-87f5-6b4e9d530ad8 req-c0e801ea-a0cb-4ef4-a692-004771dfdbc7 service nova] Enqueued Resource ID: b4ec4368-9767-4513-97e8-fd441a1aca50 with Priority: HIGHEST for action port [ 724.796235] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_rules [ 724.796420] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 724.796567] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ec4368-9767-4513-97e8-fd441a1aca50 with Priority: HIGHEST for action port [ 724.797895] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.798139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.798255] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.799224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.799224] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.800319] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.800319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.800319] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4ec4368-9767-4513-97e8-fd441a1aca50 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.800319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.800319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.800319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.800319] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4ec4368-9767-4513-97e8-fd441a1aca50',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.858067] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc in Status: SUCCESS [ 724.860165] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc deletion is rescheduled due to dependency. [ 724.860284] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.303120] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.303354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.303439] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4ec4368-9767-4513-97e8-fd441a1aca50 with status ACTIVE [ 725.303607] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.303713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.303785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.304017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.304117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.304293] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.304391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.304454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.304609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.304688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.304872] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.304965] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.305039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.305184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.305285] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.305352] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4ec4368-9767-4513-97e8-fd441a1aca50 is going to be updated. [ 725.326781] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.327018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.327018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.327320] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.327407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.327625] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.051819] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 726.052057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.052233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.052450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.053294] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.053498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.053597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.054536] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.054536] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.054639] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.471604] env[69499]: INFO networking_nsxv3.common.synchronization [None req-54cd89be-69f2-4ff8-b855-315e682f9600 None None] Enqueued Resource ID: e80b5463-e225-4846-8a0c-758da2f7da95 with Priority: HIGHEST for action port [ 726.472274] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e80b5463-e225-4846-8a0c-758da2f7da95 with Priority: HIGHEST for action port [ 726.472581] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e80b5463-e225-4846-8a0c-758da2f7da95 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.472669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e80b5463-e225-4846-8a0c-758da2f7da95" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.472717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e80b5463-e225-4846-8a0c-758da2f7da95" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.472933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e80b5463-e225-4846-8a0c-758da2f7da95" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.477635] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e80b5463-e225-4846-8a0c-758da2f7da95',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.559057] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.723553] env[69499]: INFO networking_nsxv3.common.synchronization [req-8a0d4c14-8976-4595-8482-47b48a487229 req-5cd8a329-de6d-402c-9c88-822e65f9df17 tempest-ServerActionsTestJSON-629709431 tempest-ServerActionsTestJSON-629709431-project-member] Enqueued Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 726.724158] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 726.725025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.725308] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.725448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.725789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.725992] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.726087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.726180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.726429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.726774] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.726939] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.924028] env[69499]: INFO networking_nsxv3.common.synchronization [None req-27296d2b-6fbc-4f59-bd5a-0ede60778337 tempest-ServerActionsV293TestJSON-1166940701 tempest-ServerActionsV293TestJSON-1166940701-project-member] Enqueued Resource ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f with Priority: HIGHEST for action security_group_rules [ 726.924724] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f with Priority: HIGHEST for action security_group_rules [ 726.926140] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44133d71-0f30-4e7f-9c96-2491812bcd1f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.926926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.926926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.927158] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.927337] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44133d71-0f30-4e7f-9c96-2491812bcd1f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.980193] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e80b5463-e225-4846-8a0c-758da2f7da95 [ 726.980535] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.980697] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.980772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.981069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.981177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.981256] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e80b5463-e225-4846-8a0c-758da2f7da95 already deleted. [ 726.981332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e80b5463-e225-4846-8a0c-758da2f7da95" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.059537] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.070836] env[69499]: INFO networking_nsxv3.common.synchronization [None req-ceadf62d-0369-4023-bdee-df35c5189310 tempest-ServerActionsV293TestJSON-1166940701 tempest-ServerActionsV293TestJSON-1166940701-project-member] Enqueued Resource ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f with Priority: HIGHEST for action security_group_rules [ 727.071416] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f with Priority: HIGHEST for action security_group_rules [ 727.071756] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44133d71-0f30-4e7f-9c96-2491812bcd1f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.072179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.231024] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.231024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.231024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.231024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.231024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.231024] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.231024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.231024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.231024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.231024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.231024] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 already deleted. [ 727.231024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.451933] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.452099] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.452173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.452379] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.452472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.452566] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f already deleted. [ 727.452686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.452875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.453421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.453421] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44133d71-0f30-4e7f-9c96-2491812bcd1f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.508328] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-76 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.508669] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.508669] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.511281] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.511658] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.511872] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.511949] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.513643] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.513643] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.513643] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.513643] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.513643] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.513643] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.514012] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.514012] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.514012] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.533608] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.533788] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 727.533933] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.534128] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.534444] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-4c61cc51-19d5-43c2-9ed7-125cb4798192 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.534648] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-4c61cc51-19d5-43c2-9ed7-125cb4798192" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.534817] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-4c61cc51-19d5-43c2-9ed7-125cb4798192" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.535141] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-4c61cc51-19d5-43c2-9ed7-125cb4798192" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.535282] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c61cc51-19d5-43c2-9ed7-125cb4798192',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.567994] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.567994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.567994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.567994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.567994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.567994] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 727.593748] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.593939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.593939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.594516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.594516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.601629] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 727.973388] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.973581] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.973687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.973977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.974133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.974266] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f already deleted. [ 727.974373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.040776] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.040776] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.040776] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.040776] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.040776] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.040776] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 4c61cc51-19d5-43c2-9ed7-125cb4798192 not found, creating... [ 728.040776] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.040776] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.040776] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.040776] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.040776] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.041309] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.041309] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.041309] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.041309] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.041309] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.041703] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 4c61cc51-19d5-43c2-9ed7-125cb4798192 is going to be created. [ 728.065415] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.065415] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.065415] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.065415] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.065415] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.065415] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-4c61cc51-19d5-43c2-9ed7-125cb4798192" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.773160] env[69499]: INFO networking_nsxv3.common.synchronization [req-8a0d4c14-8976-4595-8482-47b48a487229 req-59d902d5-0b62-424d-8ee9-111ebfa19554 service nova] Enqueued Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_rules [ 728.773447] env[69499]: INFO networking_nsxv3.common.synchronization [req-8a0d4c14-8976-4595-8482-47b48a487229 req-59d902d5-0b62-424d-8ee9-111ebfa19554 service nova] Enqueued Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 728.773567] env[69499]: INFO networking_nsxv3.common.synchronization [req-8a0d4c14-8976-4595-8482-47b48a487229 req-59d902d5-0b62-424d-8ee9-111ebfa19554 service nova] Enqueued Resource ID: 4c61cc51-19d5-43c2-9ed7-125cb4798192 with Priority: HIGHEST for action port [ 728.774126] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_rules [ 728.774268] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 728.774370] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c61cc51-19d5-43c2-9ed7-125cb4798192 with Priority: HIGHEST for action port [ 728.774663] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.774813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.774857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.775408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.775495] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.776862] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.776955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.777052] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.777252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.777957] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.777957] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.778042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.778209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.778324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.778420] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.779286] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c61cc51-19d5-43c2-9ed7-125cb4798192 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.779391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c61cc51-19d5-43c2-9ed7-125cb4798192" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.779465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c61cc51-19d5-43c2-9ed7-125cb4798192" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.779671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c61cc51-19d5-43c2-9ed7-125cb4798192" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.779813] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c61cc51-19d5-43c2-9ed7-125cb4798192',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.260528] env[69499]: INFO networking_nsxv3.common.synchronization [None req-d5311c54-3f5c-4b3c-ab2e-0d48ce0ea356 None None] Enqueued Resource ID: 2709c035-1afc-4912-b224-14e902608180 with Priority: HIGHEST for action port [ 729.261228] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2709c035-1afc-4912-b224-14e902608180 with Priority: HIGHEST for action port [ 729.261596] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-2709c035-1afc-4912-b224-14e902608180 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.261721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2709c035-1afc-4912-b224-14e902608180" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.261795] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2709c035-1afc-4912-b224-14e902608180" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.262178] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2709c035-1afc-4912-b224-14e902608180" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.262294] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2709c035-1afc-4912-b224-14e902608180',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.281926] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.282889] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.282999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.283256] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c61cc51-19d5-43c2-9ed7-125cb4798192 with status ACTIVE [ 729.283324] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.283432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.283506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.283701] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.283790] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.283956] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.284065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.284129] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.284280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.284361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.284543] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.284634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.284695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.284835] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.284907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.284992] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c61cc51-19d5-43c2-9ed7-125cb4798192 is going to be updated. [ 729.306168] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.306241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.306338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.306527] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.306662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.306819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c61cc51-19d5-43c2-9ed7-125cb4798192" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.611168] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 729.611397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.611464] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.611675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.611864] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.611974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.612045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.612204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.612287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.612375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.612467] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.763930] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2709c035-1afc-4912-b224-14e902608180 [ 729.764190] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.764369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.764438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.764674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.764767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.764867] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2709c035-1afc-4912-b224-14e902608180 already deleted. [ 729.764938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2709c035-1afc-4912-b224-14e902608180" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.787450] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.119911] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.120078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.120165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.120371] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.120563] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.120666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.120726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.121069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.121069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.121214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.121261] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.121326] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.121380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.121524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.121659] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.121748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.121800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.121936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.122026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.122097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.122179] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.292561] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.292561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.292561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.292561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.292561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.292561] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 is going to be created. [ 730.313785] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.313921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.313998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.314227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.314388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.331610] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: UNINITIALIZED for 2s [ 730.625414] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51d37fb6-4b72-4eba-930a-b89442ed8859: rpc.has_security_group_logging(os_id): False [ 730.645989] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.646755] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.646755] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.646755] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.646755] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.647187] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.647411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.647477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.647654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.647767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.648024] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.648133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.649631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.649631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.649631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.649631] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.649631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.649631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.649631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.649631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.649631] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 730.705813] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.706569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.706569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.706569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.706782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.720535] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 731.747510] env[69499]: INFO networking_nsxv3.common.synchronization [req-23f7af74-ffae-4ff0-846b-dcce1e4508f7 req-ef82cd7e-f681-4819-ac71-844d24393f34 tempest-ServersTestMultiNic-453281866 tempest-ServersTestMultiNic-453281866-project-member] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 731.748047] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 731.748362] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.748499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.748586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.748860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.749041] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.749228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.749228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.749390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.749519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.749614] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.082473] env[69499]: INFO networking_nsxv3.common.synchronization [req-23f7af74-ffae-4ff0-846b-dcce1e4508f7 req-2a8d8ce6-c572-4899-8cbb-0bf77cfaf15b tempest-ServersTestMultiNic-453281866 tempest-ServersTestMultiNic-453281866-project-member] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 732.083068] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 732.083367] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.083517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.255018] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.255018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.255018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.255018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.255018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.255018] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.255018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.255018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.255018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.255018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.255018] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 already deleted. [ 732.255018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.255018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.255018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.255018] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.255018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.255018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.255018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.255787] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.255787] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.343023] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: SUCCESS [ 732.343023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.343023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.343023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.343023] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.343023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.343023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.343023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.343023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.343023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.343023] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.460571] env[69499]: INFO networking_nsxv3.common.synchronization [req-23f7af74-ffae-4ff0-846b-dcce1e4508f7 req-c2db1dda-b9bb-484e-8a57-9c81ed2f65b6 tempest-ServersTestMultiNic-453281866 tempest-ServersTestMultiNic-453281866-project-member] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 732.461122] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 732.461408] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.461505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.737498] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 732.738558] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.764626] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.764626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.764626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.764626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.764626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.764626] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.764626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.764626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.764626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.764626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.764626] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 already deleted. [ 732.764626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.764626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.764626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.764626] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.764626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.764626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.764626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.765519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.765519] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.836350] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.836567] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-910" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.836721] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-910" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.837090] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-910" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.837421] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.837591] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.837716] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.837928] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.838086] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.838328] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.838420] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.838518] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.838637] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.838743] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.838849] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.838975] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.846862] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.857433] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.857628] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 732.857805] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.858010] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-910" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.858359] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-f11ce470-ab8e-4ed4-9b6f-16aef5593d36 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.858558] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-f11ce470-ab8e-4ed4-9b6f-16aef5593d36" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.859319] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-f11ce470-ab8e-4ed4-9b6f-16aef5593d36" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.859319] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-f11ce470-ab8e-4ed4-9b6f-16aef5593d36" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.859319] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f11ce470-ab8e-4ed4-9b6f-16aef5593d36',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.266876] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.267112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.267215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.267468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.267572] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.267778] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.267877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.267935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.268108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.268185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.268270] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 already deleted. [ 733.268351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.348643] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0fc2518-1857-49ca-8dcd-c34aaa8c5c22: rpc.has_security_group_logging(os_id): False [ 733.366021] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.366021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.366021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.366021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.366021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.366021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port f11ce470-ab8e-4ed4-9b6f-16aef5593d36 not found, creating... [ 733.366021] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.366021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.366021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.366021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.366021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.366518] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.366518] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.366518] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.366790] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.366837] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.367071] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: f11ce470-ab8e-4ed4-9b6f-16aef5593d36 is going to be created. [ 733.368824] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.368944] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.368999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.369232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.369315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.370013] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.370164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.370228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.370380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.370461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.370545] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 is going to be created. [ 733.391027] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.391027] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.391027] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.391027] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.391027] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.391027] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-f11ce470-ab8e-4ed4-9b6f-16aef5593d36" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.434215] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.434394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.434441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.434656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.434829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.446653] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: IN_PROGRESS for 2s [ 734.221846] env[69499]: INFO networking_nsxv3.common.synchronization [req-7f96c43f-d6c1-409d-adfb-0df69270c04d req-b46e7245-99dd-4dfc-a447-4c6abb71df99 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 734.222135] env[69499]: INFO networking_nsxv3.common.synchronization [req-7f96c43f-d6c1-409d-adfb-0df69270c04d req-b46e7245-99dd-4dfc-a447-4c6abb71df99 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 with Priority: HIGHEST for action security_group_members [ 734.223049] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 734.223387] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 with Priority: HIGHEST for action security_group_members [ 734.224685] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.224786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.224860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.225128] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.225466] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.225580] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.225848] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.226111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.226279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.226441] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.227772] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-588499a7-c679-4d4f-a942-afbc2a5f3516 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.228019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.228111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.228504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.229525] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.229525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.229525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.229525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.229525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.229525] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.280436] env[69499]: INFO networking_nsxv3.common.synchronization [req-23f7af74-ffae-4ff0-846b-dcce1e4508f7 req-0c274a4f-fc53-4bf3-b7de-3a14b5d73d74 service nova] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_rules [ 734.280638] env[69499]: INFO networking_nsxv3.common.synchronization [req-23f7af74-ffae-4ff0-846b-dcce1e4508f7 req-0c274a4f-fc53-4bf3-b7de-3a14b5d73d74 service nova] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 734.280798] env[69499]: INFO networking_nsxv3.common.synchronization [req-23f7af74-ffae-4ff0-846b-dcce1e4508f7 req-0c274a4f-fc53-4bf3-b7de-3a14b5d73d74 service nova] Enqueued Resource ID: f11ce470-ab8e-4ed4-9b6f-16aef5593d36 with Priority: HIGHEST for action port [ 734.281067] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_rules [ 734.281182] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 734.281307] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f11ce470-ab8e-4ed4-9b6f-16aef5593d36 with Priority: HIGHEST for action port [ 734.281867] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.281988] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.282229] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.282560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.282688] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.284144] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.284144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.284144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.284144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.284480] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.284640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.284728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.284945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.285052] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.285234] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.286595] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-f11ce470-ab8e-4ed4-9b6f-16aef5593d36 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.286725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f11ce470-ab8e-4ed4-9b6f-16aef5593d36" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.286782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f11ce470-ab8e-4ed4-9b6f-16aef5593d36" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.287052] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f11ce470-ab8e-4ed4-9b6f-16aef5593d36" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.287052] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f11ce470-ab8e-4ed4-9b6f-16aef5593d36',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.309706] env[69499]: INFO networking_nsxv3.common.synchronization [req-7f96c43f-d6c1-409d-adfb-0df69270c04d req-b46e7245-99dd-4dfc-a447-4c6abb71df99 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_rules [ 734.310059] env[69499]: INFO networking_nsxv3.common.synchronization [req-7f96c43f-d6c1-409d-adfb-0df69270c04d req-b46e7245-99dd-4dfc-a447-4c6abb71df99 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 734.310242] env[69499]: INFO networking_nsxv3.common.synchronization [req-7f96c43f-d6c1-409d-adfb-0df69270c04d req-b46e7245-99dd-4dfc-a447-4c6abb71df99 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 with Priority: HIGHEST for action security_group_rules [ 734.310376] env[69499]: INFO networking_nsxv3.common.synchronization [req-7f96c43f-d6c1-409d-adfb-0df69270c04d req-b46e7245-99dd-4dfc-a447-4c6abb71df99 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 with Priority: HIGHEST for action security_group_members [ 734.310519] env[69499]: INFO networking_nsxv3.common.synchronization [req-7f96c43f-d6c1-409d-adfb-0df69270c04d req-b46e7245-99dd-4dfc-a447-4c6abb71df99 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: b4ec4368-9767-4513-97e8-fd441a1aca50 with Priority: HIGHEST for action port [ 734.311591] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_rules [ 734.311747] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 with Priority: HIGHEST for action security_group_rules [ 734.312033] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ec4368-9767-4513-97e8-fd441a1aca50 with Priority: HIGHEST for action port [ 734.312180] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 734.312280] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 with Priority: HIGHEST for action security_group_members [ 734.312604] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.312751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.312812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.313037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.313133] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.313941] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-588499a7-c679-4d4f-a942-afbc2a5f3516 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.314087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.314176] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.314381] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.314481] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.315487] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4ec4368-9767-4513-97e8-fd441a1aca50 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.315792] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.315864] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.316069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.316170] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4ec4368-9767-4513-97e8-fd441a1aca50',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.316881] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.316977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.318514] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-588499a7-c679-4d4f-a942-afbc2a5f3516 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.318514] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.420022] env[69499]: INFO networking_nsxv3.common.synchronization [req-76dd6aa0-f9e0-41f7-abf7-328e53dc62c4 req-cb5a8d71-ced3-4b33-8c75-dcb17bfe91e1 tempest-FloatingIPsAssociationTestJSON-1168940114 tempest-FloatingIPsAssociationTestJSON-1168940114-project-member] Enqueued Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_members [ 734.420022] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_members [ 734.420022] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-04847a44-8459-4dcc-b6cd-80a364fba3d0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.420022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.420022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.420022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.420022] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.420022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.420022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.420022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.420466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.420466] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.730874] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.731830] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.789266] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.789481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.790798] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.791683] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f11ce470-ab8e-4ed4-9b6f-16aef5593d36 with status ACTIVE [ 734.791881] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.792145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.792145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.792288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.792378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.792558] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.792658] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.792721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.792875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.792956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.793158] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.793290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.793342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.793462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.793537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.793611] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f11ce470-ab8e-4ed4-9b6f-16aef5593d36 is going to be updated. [ 734.808082] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.808517] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-95" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.808646] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-95" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.808982] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-95" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.809305] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.809479] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.809611] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.809821] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.809969] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.810197] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.810316] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.810429] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.810576] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.810723] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.810837] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.810975] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 734.815186] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.815362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.815414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.815590] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.815721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.815878] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f11ce470-ab8e-4ed4-9b6f-16aef5593d36" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.819473] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.819789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.820020] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4ec4368-9767-4513-97e8-fd441a1aca50 with status ACTIVE [ 734.820204] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.820425] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.820504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.820804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.820914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.821490] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.821664] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.821749] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.822274] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.822363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.822749] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.822889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.822939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.823303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.823410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.823512] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4ec4368-9767-4513-97e8-fd441a1aca50 is going to be updated. [ 734.825455] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-588499a7-c679-4d4f-a942-afbc2a5f3516 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.825586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.847954] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 734.848235] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 734.848410] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 734.848600] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-95" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.849055] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-a17584b6-f47f-4f4d-8e39-8daf7fa48aeb taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.849160] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-a17584b6-f47f-4f4d-8e39-8daf7fa48aeb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.849242] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-a17584b6-f47f-4f4d-8e39-8daf7fa48aeb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.849612] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-a17584b6-f47f-4f4d-8e39-8daf7fa48aeb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.849927] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a17584b6-f47f-4f4d-8e39-8daf7fa48aeb',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.861635] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.861798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.861870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.862100] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.862239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.862394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.924031] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.191542] env[69499]: INFO networking_nsxv3.common.synchronization [req-acfe42d6-6c7e-48f1-a5cb-43090812d6b6 req-37cbaeaf-a19b-4b80-a3ef-9494fd9c71ec tempest-ImagesTestJSON-490670806 tempest-ImagesTestJSON-490670806-project-member] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 735.192673] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 735.193075] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.193250] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.193352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.193740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.193858] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.194014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.194115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.194340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.194474] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.194617] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.233122] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.234207] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.269193] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.269480] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-612" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.269670] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-612" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.270120] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-612" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.270504] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.270740] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.270923] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.271275] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.271492] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.271794] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.271971] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.272164] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.272337] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.272517] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.272685] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.272886] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.292909] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.293135] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 735.293359] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.293615] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-612" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.294097] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.294315] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.294502] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.294903] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.295155] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.296441] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.352579] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.352792] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.352917] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.353248] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.353401] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.353565] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port a17584b6-f47f-4f4d-8e39-8daf7fa48aeb not found, creating... [ 735.353918] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.354103] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.354222] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.354480] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.354584] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.354866] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.355083] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.355137] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.355348] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.355480] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.355620] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: a17584b6-f47f-4f4d-8e39-8daf7fa48aeb is going to be created. [ 735.392758] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.393028] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.393153] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.393426] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.393651] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.393869] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-a17584b6-f47f-4f4d-8e39-8daf7fa48aeb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.425530] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.458125] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: SUCCESS [ 735.458353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.697050] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.697253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.697394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.697642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.697723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.697958] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.698099] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.698172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.698355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.698442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.698516] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 735.726988] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.727183] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.727241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.727497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.727723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.735881] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 735.736297] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.736786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.736786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.736786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.736930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.736930] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 735.738318] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.738468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.738633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.738747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.738861] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.738975] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 is going to be created. [ 735.767756] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.767942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.768028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.768289] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.768508] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.773641] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.773764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.773808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.774105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.774297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.779584] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 in Status: UNINITIALIZED for 2s [ 735.781079] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 735.799634] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.799634] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.799634] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.799940] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.799940] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.800146] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b not found, creating... [ 735.800441] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.800652] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.800760] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.800998] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.801161] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.801469] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.801640] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.801774] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.802015] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.802172] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.802323] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b is going to be created. [ 735.803571] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.803713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.803759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.803928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.804049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.804153] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be created. [ 735.841739] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.841978] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.842097] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.843317] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.843616] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.843881] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.845675] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.845777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.845777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.846239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.846239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.859998] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: UNINITIALIZED for 2s [ 735.930753] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.930932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.931137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.931218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.931279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.931388] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 is going to be updated. [ 735.973165] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.973340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.973513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.973629] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.973860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.984162] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: IN_PROGRESS for 2s [ 736.159028] env[69499]: INFO networking_nsxv3.common.synchronization [req-76dd6aa0-f9e0-41f7-abf7-328e53dc62c4 req-6807bd52-25a8-4631-b2a6-b81899308271 service nova] Enqueued Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_rules [ 736.159114] env[69499]: INFO networking_nsxv3.common.synchronization [req-76dd6aa0-f9e0-41f7-abf7-328e53dc62c4 req-6807bd52-25a8-4631-b2a6-b81899308271 service nova] Enqueued Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_members [ 736.159240] env[69499]: INFO networking_nsxv3.common.synchronization [req-76dd6aa0-f9e0-41f7-abf7-328e53dc62c4 req-6807bd52-25a8-4631-b2a6-b81899308271 service nova] Enqueued Resource ID: a17584b6-f47f-4f4d-8e39-8daf7fa48aeb with Priority: HIGHEST for action port [ 736.159474] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_rules [ 736.160116] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_members [ 736.160116] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a17584b6-f47f-4f4d-8e39-8daf7fa48aeb with Priority: HIGHEST for action port [ 736.163084] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04847a44-8459-4dcc-b6cd-80a364fba3d0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.163223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.163293] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.166438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.166438] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.166438] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-04847a44-8459-4dcc-b6cd-80a364fba3d0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.166438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.166438] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-a17584b6-f47f-4f4d-8e39-8daf7fa48aeb taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.166438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a17584b6-f47f-4f4d-8e39-8daf7fa48aeb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.166438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a17584b6-f47f-4f4d-8e39-8daf7fa48aeb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.166438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a17584b6-f47f-4f4d-8e39-8daf7fa48aeb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.166438] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a17584b6-f47f-4f4d-8e39-8daf7fa48aeb',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.617710] env[69499]: INFO networking_nsxv3.common.synchronization [req-23f7af74-ffae-4ff0-846b-dcce1e4508f7 req-07774fee-29b6-4516-8d72-7e33e2b039cd service nova] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_rules [ 736.617710] env[69499]: INFO networking_nsxv3.common.synchronization [req-23f7af74-ffae-4ff0-846b-dcce1e4508f7 req-07774fee-29b6-4516-8d72-7e33e2b039cd service nova] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 736.618167] env[69499]: INFO networking_nsxv3.common.synchronization [req-23f7af74-ffae-4ff0-846b-dcce1e4508f7 req-07774fee-29b6-4516-8d72-7e33e2b039cd service nova] Enqueued Resource ID: 06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b with Priority: HIGHEST for action port [ 736.618552] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_rules [ 736.618552] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 736.618665] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b with Priority: HIGHEST for action port [ 736.618885] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.619075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.619201] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.619393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.621968] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.622357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.622357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.622510] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.622510] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.666706] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-04847a44-8459-4dcc-b6cd-80a364fba3d0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.666833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.667732] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a17584b6-f47f-4f4d-8e39-8daf7fa48aeb with status ACTIVE [ 736.667732] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.667732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.667732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.667732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.667959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.668066] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.669154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.669154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.669154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.669154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.669154] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.669154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.669154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.669154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.669453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.669453] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a17584b6-f47f-4f4d-8e39-8daf7fa48aeb is going to be updated. [ 736.691299] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.691497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.691622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.691892] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.692043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.692220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a17584b6-f47f-4f4d-8e39-8daf7fa48aeb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.124895] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b with status ACTIVE [ 737.125621] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.125621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.125621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.125876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.125876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.126011] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.126123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.126186] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.126355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.126438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.126628] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.126722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.126783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.126922] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.126996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.127093] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b is going to be updated. [ 737.150196] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.150338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.150407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.150592] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.150725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.150897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06e07d84-6bb4-4ee6-bae2-83f1e5fbb09b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.496711] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.496995] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-910" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.497112] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-910" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.497316] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-910" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.497597] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.497757] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.497944] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.498239] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.498439] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.498690] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.498878] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.498958] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.499076] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.499136] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.499229] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.499360] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.518253] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.518411] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 737.518552] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.518716] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-910" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.518990] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.519169] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.519288] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.519572] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.519771] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.750327] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 737.750607] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de deletion is rescheduled due to dependency. [ 737.750705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.791931] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 in Status: SUCCESS [ 737.793346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.796647] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.797126] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.797249] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.797450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.797673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.797731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.798194] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.798194] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.800479] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 737.800479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.800479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.800479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.800798] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.800798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.800889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.801054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.801157] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.801252] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.871246] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 737.871526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.871717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.871957] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.872175] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.872289] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.872368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.872526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.872700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.872700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.872822] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.873724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.873948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.874128] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.874231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.874306] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.874451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.874541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.874629] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.992966] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: SUCCESS [ 737.994032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.994032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.994032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.994032] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.994266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.994341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.994460] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.994545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.994657] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.022423] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.022646] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.022775] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.023158] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.023268] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.023503] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc not found, creating... [ 738.023862] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.024060] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.024256] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.024551] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.024702] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.025011] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.025391] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.025606] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.025854] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.025994] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.026158] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc is going to be created. [ 738.057594] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.057594] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.057594] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.057594] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.057594] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.057594] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.304344] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.304344] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.378227] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.378350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.378593] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.496753] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.680942] env[69499]: INFO networking_nsxv3.common.synchronization [req-6972985e-7c7d-48b7-aae8-58065b6fa27d req-d74b6119-8931-42f5-9eee-09ca87ab2fc5 tempest-ListImageFiltersTestJSON-1801888174 tempest-ListImageFiltersTestJSON-1801888174-project-member] Enqueued Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_members [ 738.681522] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 with Priority: HIGHEST for action security_group_members [ 738.681821] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba52dd6-05d0-4283-ba0e-107ad8c10157 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.681937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.682195] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.682428] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.682592] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.682691] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.682750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.682903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.682986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.683085] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dba52dd6-05d0-4283-ba0e-107ad8c10157',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.805946] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.806921] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.881110] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.000919] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.185251] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.185499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.185499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.185706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.185782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.185987] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.186093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.186156] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.186306] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.186385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.186506] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 is going to be updated. [ 739.214793] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.215213] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.215325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.215586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.215726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.226758] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: IN_PROGRESS for 2s [ 739.308984] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.309204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.309277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.309539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.309632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.309735] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 is going to be updated. [ 739.311021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.311089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.311154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.311329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.311427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.311528] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 739.340429] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.340573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.340646] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.340860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.341009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.342615] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.342722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.342789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.346022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.346022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.352238] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 739.352825] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 in Status: IN_PROGRESS for 2s [ 739.387633] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.387783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.387856] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.388097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.388191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.388287] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be updated. [ 739.395708] env[69499]: INFO networking_nsxv3.common.synchronization [req-23f7af74-ffae-4ff0-846b-dcce1e4508f7 req-d8d37d0f-dde8-4a32-8d8e-a6a1ef490c6c service nova] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_rules [ 739.395912] env[69499]: INFO networking_nsxv3.common.synchronization [req-23f7af74-ffae-4ff0-846b-dcce1e4508f7 req-d8d37d0f-dde8-4a32-8d8e-a6a1ef490c6c service nova] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 739.396028] env[69499]: INFO networking_nsxv3.common.synchronization [req-23f7af74-ffae-4ff0-846b-dcce1e4508f7 req-d8d37d0f-dde8-4a32-8d8e-a6a1ef490c6c service nova] Enqueued Resource ID: 44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc with Priority: HIGHEST for action port [ 739.396244] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_rules [ 739.396366] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 739.396457] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc with Priority: HIGHEST for action port [ 739.396970] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.397077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.397249] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.397383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.397525] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.397621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.397682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.397861] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.397934] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.434954] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.435172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.435281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.435582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.436473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.446932] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 2s [ 739.514476] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.514476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.514476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.514476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.514476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.514476] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 is going to be updated. [ 739.542049] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.542198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.542268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.542463] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.542727] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.552024] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: IN_PROGRESS for 2s [ 739.853408] env[69499]: INFO networking_nsxv3.common.synchronization [req-40790826-4f5e-4038-99cc-02469d77208e req-c2e9e875-6a3f-4d25-92e7-999bf519543d tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe with Priority: HIGHEST for action security_group_members [ 739.853408] env[69499]: INFO networking_nsxv3.common.synchronization [req-40790826-4f5e-4038-99cc-02469d77208e req-c2e9e875-6a3f-4d25-92e7-999bf519543d tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 739.853408] env[69499]: INFO networking_nsxv3.common.synchronization [req-40790826-4f5e-4038-99cc-02469d77208e req-c2e9e875-6a3f-4d25-92e7-999bf519543d tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 with Priority: HIGHEST for action security_group_members [ 739.853879] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe with Priority: HIGHEST for action security_group_members [ 739.854595] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 739.854816] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 with Priority: HIGHEST for action security_group_members [ 739.855241] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8da13-e4da-484e-9398-2fe76dfeb0fe taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.855541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.855728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.856078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.857264] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.857555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.857734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.858027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.859031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.859031] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20c8da13-e4da-484e-9398-2fe76dfeb0fe',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.859966] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.860213] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.860904] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-588499a7-c679-4d4f-a942-afbc2a5f3516 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.861715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.903019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc with status ACTIVE [ 739.903019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.903019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.903019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.903019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.903019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.903019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.903019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.903019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.903019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.903019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.903019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.903019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.903019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.903019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.903019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.903019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc is going to be updated. [ 739.943365] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.943365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.943365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.943365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.943365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.943365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44d0d8a5-41b8-41c8-8dd0-bd8a3bcec5bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.943365] env[69499]: INFO networking_nsxv3.common.synchronization [req-40790826-4f5e-4038-99cc-02469d77208e req-c2e9e875-6a3f-4d25-92e7-999bf519543d tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe with Priority: HIGHEST for action security_group_rules [ 739.943365] env[69499]: INFO networking_nsxv3.common.synchronization [req-40790826-4f5e-4038-99cc-02469d77208e req-c2e9e875-6a3f-4d25-92e7-999bf519543d tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe with Priority: HIGHEST for action security_group_members [ 739.944101] env[69499]: INFO networking_nsxv3.common.synchronization [req-40790826-4f5e-4038-99cc-02469d77208e req-c2e9e875-6a3f-4d25-92e7-999bf519543d tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_rules [ 739.944378] env[69499]: INFO networking_nsxv3.common.synchronization [req-40790826-4f5e-4038-99cc-02469d77208e req-c2e9e875-6a3f-4d25-92e7-999bf519543d tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 739.944615] env[69499]: INFO networking_nsxv3.common.synchronization [req-40790826-4f5e-4038-99cc-02469d77208e req-c2e9e875-6a3f-4d25-92e7-999bf519543d tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 with Priority: HIGHEST for action security_group_rules [ 739.944845] env[69499]: INFO networking_nsxv3.common.synchronization [req-40790826-4f5e-4038-99cc-02469d77208e req-c2e9e875-6a3f-4d25-92e7-999bf519543d tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 with Priority: HIGHEST for action security_group_members [ 739.945102] env[69499]: INFO networking_nsxv3.common.synchronization [req-40790826-4f5e-4038-99cc-02469d77208e req-c2e9e875-6a3f-4d25-92e7-999bf519543d tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: b4ec4368-9767-4513-97e8-fd441a1aca50 with Priority: HIGHEST for action port [ 739.945418] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe with Priority: HIGHEST for action security_group_rules [ 739.945634] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_rules [ 739.945853] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 with Priority: HIGHEST for action security_group_members [ 739.946053] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ec4368-9767-4513-97e8-fd441a1aca50 with Priority: HIGHEST for action port [ 739.946229] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 with Priority: HIGHEST for action security_group_rules [ 739.946416] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe with Priority: HIGHEST for action security_group_members [ 739.946596] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 739.947358] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20c8da13-e4da-484e-9398-2fe76dfeb0fe taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.947611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.947766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.948088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.948888] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20c8da13-e4da-484e-9398-2fe76dfeb0fe',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.949812] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.950703] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.951537] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-588499a7-c679-4d4f-a942-afbc2a5f3516 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.951750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.952037] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4ec4368-9767-4513-97e8-fd441a1aca50 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.953302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.953302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.953302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.953302] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4ec4368-9767-4513-97e8-fd441a1aca50',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.953879] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-588499a7-c679-4d4f-a942-afbc2a5f3516 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.954102] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.954415] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8da13-e4da-484e-9398-2fe76dfeb0fe taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.954626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.954894] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.955100] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.362378] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20c8da13-e4da-484e-9398-2fe76dfeb0fe',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.457023] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4ec4368-9767-4513-97e8-fd441a1aca50 with status ACTIVE [ 740.457023] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.457023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.457023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.457023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.457023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.457023] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.457023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.457023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.457023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.457023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.457023] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.457023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.457023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.457023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.457023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.457023] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4ec4368-9767-4513-97e8-fd441a1aca50 is going to be updated. [ 740.459710] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8da13-e4da-484e-9398-2fe76dfeb0fe taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.460086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.482374] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.482374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.482374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.482374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.482374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.482374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4ec4368-9767-4513-97e8-fd441a1aca50" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.864516] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20c8da13-e4da-484e-9398-2fe76dfeb0fe',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.237646] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 in Status: SUCCESS [ 741.237646] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dba52dd6-05d0-4283-ba0e-107ad8c10157 deletion is rescheduled due to dependency. [ 741.237646] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba52dd6-05d0-4283-ba0e-107ad8c10157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.364135] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 741.364135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.364135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.364135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.364135] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.364435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.364435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.364435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.364579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.364579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.364654] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.366099] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 in Status: SUCCESS [ 741.366304] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.366625] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.366702] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.366901] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.367072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.367118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.367300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.367414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.367523] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.368285] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.368486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.368794] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.368887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.368926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.369083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.369155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.369235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.369318] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.370908] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.370908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.371017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.371340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.371442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.371530] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe is going to be created. [ 741.373804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.373804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.373804] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.373933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.373933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.374139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.374139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.374215] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.395711] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.395858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.395943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.396168] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.396344] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.405895] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe in Status: UNINITIALIZED for 2s [ 741.459203] env[69499]: INFO networking_nsxv3.common.synchronization [req-d6307070-3a65-43b1-bc20-271d95ba07dd req-e289c09d-5293-4451-9f7f-3fd5e532baec tempest-ServersAdminTestJSON-2112223204 tempest-ServersAdminTestJSON-2112223204-project-member] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 741.459203] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 741.462187] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.462307] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.462307] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.463556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.463556] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.463556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.463556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.463709] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.463709] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.463766] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.469261] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 741.469469] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.469643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.469871] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.470072] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.470195] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.470264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.470522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.470587] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.470649] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.471435] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.471435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.471435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.471435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.471435] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.471435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.471788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.471788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.471788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.471867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.471894] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.472936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.473139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.473302] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.473422] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.473488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.473662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.473743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.473839] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.561469] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: SUCCESS [ 741.561687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.561851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.562112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.562424] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.562424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.562542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.562622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.562705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.562789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.562877] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.871751] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.873441] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.873605] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.876212] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.877769] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.969915] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.981727] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb18857e-504d-46d0-8833-741cccaef5b3: rpc.has_security_group_logging(os_id): False [ 741.981727] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.000481] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.003478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.003478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.003478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.003478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.003478] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.003478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.003478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.003478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.003478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.003478] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.003478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.003478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.003478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.003478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.004609] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.004609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.004609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.004609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.004609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.004609] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be created. [ 742.007328] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-797 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.007589] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.007710] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.007975] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.008200] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.008352] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.008646] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.008900] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.009026] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.009950] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.009950] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.009950] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.009950] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.009950] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.009950] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.010187] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.029924] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.030143] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 742.030286] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.030485] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.030826] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-2b7d424c-b337-4be9-a58f-14657853ce3f taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.031012] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-2b7d424c-b337-4be9-a58f-14657853ce3f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.031141] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-2b7d424c-b337-4be9-a58f-14657853ce3f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.031491] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-2b7d424c-b337-4be9-a58f-14657853ce3f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.031640] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b7d424c-b337-4be9-a58f-14657853ce3f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.066414] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-04847a44-8459-4dcc-b6cd-80a364fba3d0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.066414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.066585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.066778] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.066994] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.067234] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.067234] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.067443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.067553] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.067647] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.067816] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-04847a44-8459-4dcc-b6cd-80a364fba3d0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.067923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.067995] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.068200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.068362] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.068455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.068536] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.068679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.069604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.069767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.069852] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.071655] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.071802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.071875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.072058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.072204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.083975] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 2s [ 742.375070] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.379769] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 588499a7-c679-4d4f-a942-afbc2a5f3516: rpc.has_security_group_logging(os_id): False [ 742.380232] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.398563] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.398744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.398812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.399056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.399232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.399465] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.399677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.399677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.400214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.400214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.400214] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 is going to be created. [ 742.450720] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.450895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.450934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.451162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.451333] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.461265] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 in Status: IN_PROGRESS for 2s [ 742.474530] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.485553] env[69499]: INFO networking_nsxv3.common.synchronization [req-ff89a4ab-48d4-43c7-855d-86e8349599a2 req-1eda6916-41a7-4353-98d6-275d583e048e tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe with Priority: HIGHEST for action security_group_members [ 742.485729] env[69499]: INFO networking_nsxv3.common.synchronization [req-ff89a4ab-48d4-43c7-855d-86e8349599a2 req-1eda6916-41a7-4353-98d6-275d583e048e tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 742.485865] env[69499]: INFO networking_nsxv3.common.synchronization [req-ff89a4ab-48d4-43c7-855d-86e8349599a2 req-1eda6916-41a7-4353-98d6-275d583e048e tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 with Priority: HIGHEST for action security_group_members [ 742.486669] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe with Priority: HIGHEST for action security_group_members [ 742.486811] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 742.486909] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 with Priority: HIGHEST for action security_group_members [ 742.487195] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8da13-e4da-484e-9398-2fe76dfeb0fe taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.487294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.487505] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.487594] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.487774] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-588499a7-c679-4d4f-a942-afbc2a5f3516 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.487855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.488039] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.537227] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.537227] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.537227] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.537227] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.537227] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.538309] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 2b7d424c-b337-4be9-a58f-14657853ce3f not found, creating... [ 742.538956] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.539322] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.539491] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.540175] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.540327] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.540638] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.540795] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.540907] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.541132] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.541261] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.541398] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 2b7d424c-b337-4be9-a58f-14657853ce3f is going to be created. [ 742.559399] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.559585] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.559704] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.559948] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.560173] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.560390] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-2b7d424c-b337-4be9-a58f-14657853ce3f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.574660] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04847a44-8459-4dcc-b6cd-80a364fba3d0: rpc.has_security_group_logging(os_id): False [ 742.590330] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.590476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.590548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.590751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.590846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.591069] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.591171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.591237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.591400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.591479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.591665] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.591761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.591824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.591963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.592053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.592231] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.592345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.592383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.592514] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.592589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.592675] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 is going to be updated. [ 742.677705] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.677842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.677942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.678135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.678276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.695341] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: IN_PROGRESS for 2s [ 742.877835] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.877835] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.877835] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.879380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.879631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.879713] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 742.882864] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.883050] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.883112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.883281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.883373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.883539] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 is going to be updated. [ 742.931597] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.931597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.931597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.931882] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.931882] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.939891] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.940062] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.940211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.940336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.940482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.945132] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 742.949800] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 in Status: IN_PROGRESS for 2s [ 742.980369] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.980369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.980369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.980369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.980369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.980369] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be updated. [ 742.990140] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.990382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.990382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.991842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.991842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.991842] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be updated. [ 743.011403] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.011538] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.011603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.011799] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.011928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.015429] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.015548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.015615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.015784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.015900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.023767] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 743.024452] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 2s [ 743.366476] env[69499]: INFO networking_nsxv3.common.synchronization [req-d6307070-3a65-43b1-bc20-271d95ba07dd req-cf418de1-cddf-4750-91f3-df7f04cdac43 service nova] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_rules [ 743.366802] env[69499]: INFO networking_nsxv3.common.synchronization [req-d6307070-3a65-43b1-bc20-271d95ba07dd req-cf418de1-cddf-4750-91f3-df7f04cdac43 service nova] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 743.367150] env[69499]: INFO networking_nsxv3.common.synchronization [req-d6307070-3a65-43b1-bc20-271d95ba07dd req-cf418de1-cddf-4750-91f3-df7f04cdac43 service nova] Enqueued Resource ID: 2b7d424c-b337-4be9-a58f-14657853ce3f with Priority: HIGHEST for action port [ 743.367831] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_rules [ 743.368245] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 743.371027] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7d424c-b337-4be9-a58f-14657853ce3f with Priority: HIGHEST for action port [ 743.371027] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.371027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.371027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.371027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.371027] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.371027] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.371027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.371027] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b7d424c-b337-4be9-a58f-14657853ce3f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.371027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b7d424c-b337-4be9-a58f-14657853ce3f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.371027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b7d424c-b337-4be9-a58f-14657853ce3f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.371027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b7d424c-b337-4be9-a58f-14657853ce3f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.371027] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b7d424c-b337-4be9-a58f-14657853ce3f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.417248] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe in Status: SUCCESS [ 743.417248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.417248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.417248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.417248] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.417248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.417248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.417248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.417248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.417248] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20c8da13-e4da-484e-9398-2fe76dfeb0fe',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.874810] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.874935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.875243] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b7d424c-b337-4be9-a58f-14657853ce3f with status ACTIVE [ 743.875352] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.875473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.875557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.875774] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.875872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.876072] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.876203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.876267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.876436] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.876511] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.876859] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.876859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.876859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.876993] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.877037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.877319] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b7d424c-b337-4be9-a58f-14657853ce3f is going to be updated. [ 743.898602] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.899063] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.899063] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.899747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.900050] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.900164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b7d424c-b337-4be9-a58f-14657853ce3f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.918858] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.919198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.919296] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.919743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.919945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.920271] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.920487] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.920572] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.920855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.921094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.921165] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe is going to be deleted. [ 743.965950] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.965950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.965950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.965950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.966237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.966237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.966494] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.966696] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.966918] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.967069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.967173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.967368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.967486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.967586] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20c8da13-e4da-484e-9398-2fe76dfeb0fe',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.095943] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 744.095988] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.096312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.096396] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.096485] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.293918] env[69499]: INFO networking_nsxv3.common.synchronization [None req-3ea87ae6-102f-42a8-8b6a-c3866d2904cf None None] Enqueued Resource ID: dfd1e0aa-9456-4eca-b95b-5cbecc5547eb with Priority: HIGHEST for action port [ 744.296945] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfd1e0aa-9456-4eca-b95b-5cbecc5547eb with Priority: HIGHEST for action port [ 744.297357] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfd1e0aa-9456-4eca-b95b-5cbecc5547eb taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.297541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfd1e0aa-9456-4eca-b95b-5cbecc5547eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.297648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfd1e0aa-9456-4eca-b95b-5cbecc5547eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.298276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfd1e0aa-9456-4eca-b95b-5cbecc5547eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.298276] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfd1e0aa-9456-4eca-b95b-5cbecc5547eb',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.474020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.474020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.474020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.474020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.474020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.474020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.474020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.474020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.474020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.474020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.474020] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe already deleted. [ 744.474020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.474020] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20c8da13-e4da-484e-9398-2fe76dfeb0fe',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.475428] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 in Status: SUCCESS [ 744.475683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.475857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.476056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.476218] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.476319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.476383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.476525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.476607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.476755] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20c8da13-e4da-484e-9398-2fe76dfeb0fe',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.480341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.480341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.480341] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.599013] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.599222] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.708542] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: SUCCESS [ 744.708794] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.801917] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfd1e0aa-9456-4eca-b95b-5cbecc5547eb [ 744.802532] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.802672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.802742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.802960] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.803064] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.803160] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfd1e0aa-9456-4eca-b95b-5cbecc5547eb already deleted. [ 744.803244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfd1e0aa-9456-4eca-b95b-5cbecc5547eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.957198] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 744.957198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.958021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.958284] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.958470] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.958595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.958656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.958814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.958910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.958994] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.960604] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 in Status: SUCCESS [ 744.960604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.960758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.960917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.961088] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.961193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.961257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.961903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.961903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.961903] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.979540] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20c8da13-e4da-484e-9398-2fe76dfeb0fe',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.980496] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.980633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.980681] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.981763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.981763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.981763] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.981763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.981763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.981763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.981763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.981763] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe already deleted. [ 744.981763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.001588] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.001588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.001588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.001588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.001588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.001588] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 is going to be deleted. [ 745.033673] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 745.033822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.033977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.034204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.036057] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.037019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.037019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.037019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.037019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.037019] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.038117] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 745.038292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.041108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.041108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.041264] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.041393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.041496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.041607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.043014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.043014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.043014] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.050024] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.050024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.050024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.050024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.050024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.050024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.463658] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.464762] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.464899] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.464968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.465207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.465288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.465488] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.465609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.465609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.465762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.465831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.465918] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 is going to be deleted. [ 745.486055] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20c8da13-e4da-484e-9398-2fe76dfeb0fe: rpc.has_security_group_logging(os_id): False [ 745.494138] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.494275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.494439] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.494599] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.494696] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.494812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.494961] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.495172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.495381] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.495509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.495567] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.495735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.495826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.495917] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('588499a7-c679-4d4f-a942-afbc2a5f3516',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.508774] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.509466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.509466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.512671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.512671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.512671] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.512671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.512671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.512671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.512671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.512671] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe is going to be created. [ 745.538846] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/20c8da13-e4da-484e-9398-2fe76dfeb0fe], does not exist path=[/infra/domains/default/groups/20c8da13-e4da-484e-9398-2fe76dfeb0fe]."\n}' [ 745.540335] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/20c8da13-e4da-484e-9398-2fe76dfeb0fe [ 745.540335] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 745.543709] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.543841] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.543907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.544126] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.544291] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.544394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.544516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.544653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.544755] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.544864] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.545023] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.545120] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.545181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.545336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.545499] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.545595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.545660] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.545820] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.545908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.545991] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.546119] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.547048] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.575773] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.575773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.576513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.576751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.578011] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.578907] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.578907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.578907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.578907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.578907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.579160] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.579160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.579160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.579301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.579376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.579459] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20c8da13-e4da-484e-9398-2fe76dfeb0fe is going to be created. [ 745.597140] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/20c8da13-e4da-484e-9398-2fe76dfeb0fe], does not exist path=[/infra/domains/default/groups/20c8da13-e4da-484e-9398-2fe76dfeb0fe]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/20c8da13-e4da-484e-9398-2fe76dfeb0fe [ 745.597345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20c8da13-e4da-484e-9398-2fe76dfeb0fe" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.597915] env[69499]: Traceback (most recent call last): [ 745.598033] env[69499]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 745.598033] env[69499]: return func(*args, **kwargs) [ 745.598033] env[69499]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 745.598033] env[69499]: res.raise_for_status() [ 745.598033] env[69499]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 745.598033] env[69499]: raise HTTPError(http_error_msg, response=self) [ 745.598033] env[69499]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/20c8da13-e4da-484e-9398-2fe76dfeb0fe [ 745.598033] env[69499]: During handling of the above exception, another exception occurred: [ 745.598033] env[69499]: Traceback (most recent call last): [ 745.598033] env[69499]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 745.598033] env[69499]: listener.cb(fileno) [ 745.598033] env[69499]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 745.598033] env[69499]: result = function(*args, **kwargs) [ 745.598033] env[69499]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 745.598033] env[69499]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 745.598033] env[69499]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 745.598033] env[69499]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 745.598033] env[69499]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 745.598033] env[69499]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 745.598033] env[69499]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 745.598033] env[69499]: res.raise_for_status() [ 745.598033] env[69499]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 745.598033] env[69499]: raise HTTPError(http_error_msg, response=self) [ 745.598033] env[69499]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/20c8da13-e4da-484e-9398-2fe76dfeb0fe [ 745.598033] env[69499]: Removing descriptor: 17 [ 745.969485] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.002422] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.002578] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.002664] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.002846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.002938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.003133] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.003220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.003275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.003431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.003535] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.003627] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 588499a7-c679-4d4f-a942-afbc2a5f3516 already deleted. [ 746.004280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-588499a7-c679-4d4f-a942-afbc2a5f3516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.048359] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb18857e-504d-46d0-8833-741cccaef5b3: rpc.has_security_group_logging(os_id): False [ 746.050054] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.075394] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.075394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.075394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.075394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.091235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.091847] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.091847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.091847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.091847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.092154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.092154] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.092591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.092591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.092591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.092899] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.092899] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.092899] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.093155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.093155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.093360] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.093360] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be updated. [ 746.156416] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.156670] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.159123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.159421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.159826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.171591] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 2s [ 746.476414] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.476562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.476633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.476851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.476944] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.477057] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 746.504217] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.504369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.504435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.504631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.504769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.514106] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 746.557162] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.557266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.557331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.557606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.557708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.557800] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be updated. [ 746.583166] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.583308] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.583378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.583586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.583730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.592564] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 746.647681] env[69499]: INFO networking_nsxv3.common.synchronization [None req-0cf3e37f-0370-4abb-a155-1f4a97807086 None None] Enqueued Resource ID: 432b548d-b08e-4788-bf29-86b42d0dba23 with Priority: HIGHEST for action port [ 746.648262] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 432b548d-b08e-4788-bf29-86b42d0dba23 with Priority: HIGHEST for action port [ 746.648566] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-432b548d-b08e-4788-bf29-86b42d0dba23 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.648905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-432b548d-b08e-4788-bf29-86b42d0dba23" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.649014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-432b548d-b08e-4788-bf29-86b42d0dba23" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.649286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-432b548d-b08e-4788-bf29-86b42d0dba23" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.649361] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('432b548d-b08e-4788-bf29-86b42d0dba23',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.152421] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 432b548d-b08e-4788-bf29-86b42d0dba23 [ 747.152747] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.152816] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.152906] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.153284] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.153396] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.153505] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:432b548d-b08e-4788-bf29-86b42d0dba23 already deleted. [ 747.153632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-432b548d-b08e-4788-bf29-86b42d0dba23" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.185815] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 748.186151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.186266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.186491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.186606] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.523511] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 748.523721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.523889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.524529] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.524752] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.524870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.524936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.525275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.525275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.525438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.525485] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.525552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.525614] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.525753] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.525887] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.525975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.526046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.526175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.526241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.526317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.526412] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.527312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.527390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.527583] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.527731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.527805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.527951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.528040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.528130] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.604514] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 748.605704] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.606919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.607203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.607452] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.607615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.607711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.607903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.610368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.610368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.610368] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.692495] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.692658] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.692730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.692952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.693136] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.693236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.693300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.693449] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.693568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.693611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.693700] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.031352] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51d37fb6-4b72-4eba-930a-b89442ed8859: rpc.has_security_group_logging(os_id): False [ 749.031352] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.049021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.049021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.049021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.049021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.069535] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.070434] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.070434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.070434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.070434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.070434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.072283] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.072283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.072283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.072283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.072283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.072283] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.072283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.072283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.072283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.072283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.072283] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 749.111907] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.114277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.114439] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.114707] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.115249] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.115354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.115413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.115591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.115747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.115747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.115907] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.115995] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.116076] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.116220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.116360] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.116452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.116504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.116651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.116721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.116799] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.116889] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.132578] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.132723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.132792] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.133009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.133163] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.151797] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 749.196894] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.197213] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.197213] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.197411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.198287] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.198420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.198483] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.199091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.199091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.199468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.199931] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.199931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.199931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.200113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.200983] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.200983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.200983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.200983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.200983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.200983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.200983] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.533387] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.622288] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 645b270d-e6d4-4f84-872d-3c097c5f4722: rpc.has_security_group_logging(os_id): False [ 749.641034] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.641175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.641243] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.641454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.662114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.662114] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.662114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.662114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.662114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.662114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.662114] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.662114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.662114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.662114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.662114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.662114] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.662114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.662114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.662616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.662616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.662616] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be updated. [ 749.707520] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb18857e-504d-46d0-8833-741cccaef5b3: rpc.has_security_group_logging(os_id): False [ 749.720111] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.720254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.720321] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.720560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.720691] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.729496] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.729638] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.729702] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.730672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.731121] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.731121] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.731121] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.732376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.732376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.732376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.732376] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.732376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.732376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.732376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.732376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.732376] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.732376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.732376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.733136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.733136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.733136] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be updated. [ 749.738053] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 749.788858] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.788858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.788858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.788858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.788858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.816058] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 2s [ 750.035833] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.035999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.036091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.036310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.036406] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.036507] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 750.066347] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.066347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.066347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.066347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.066347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.073765] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 751.113927] env[69499]: INFO networking_nsxv3.common.synchronization [req-d8a5829e-9cbd-4557-be5e-383b94f40dd2 req-7f8cdfb1-2e55-48bf-acf6-42e882892d38 tempest-AttachInterfacesUnderV243Test-812043974 tempest-AttachInterfacesUnderV243Test-812043974-project-member] Enqueued Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_members [ 751.113927] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_members [ 751.114317] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.114317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.114425] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.115819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.115819] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.115819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.115819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.115819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.115819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.115819] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.151867] env[69499]: INFO networking_nsxv3.common.synchronization [req-d8a5829e-9cbd-4557-be5e-383b94f40dd2 req-7f8cdfb1-2e55-48bf-acf6-42e882892d38 tempest-AttachInterfacesUnderV243Test-812043974 tempest-AttachInterfacesUnderV243Test-812043974-project-member] Enqueued Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_rules [ 751.152094] env[69499]: INFO networking_nsxv3.common.synchronization [req-d8a5829e-9cbd-4557-be5e-383b94f40dd2 req-7f8cdfb1-2e55-48bf-acf6-42e882892d38 tempest-AttachInterfacesUnderV243Test-812043974 tempest-AttachInterfacesUnderV243Test-812043974-project-member] Enqueued Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_members [ 751.152324] env[69499]: INFO networking_nsxv3.common.synchronization [req-d8a5829e-9cbd-4557-be5e-383b94f40dd2 req-7f8cdfb1-2e55-48bf-acf6-42e882892d38 tempest-AttachInterfacesUnderV243Test-812043974 tempest-AttachInterfacesUnderV243Test-812043974-project-member] Enqueued Resource ID: dca30808-33f5-4d40-bf37-ff5bceaed787 with Priority: HIGHEST for action port [ 751.154929] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_rules [ 751.155366] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_members [ 751.155495] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dca30808-33f5-4d40-bf37-ff5bceaed787 with Priority: HIGHEST for action port [ 751.156049] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.156192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.156263] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.156464] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.156546] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.157397] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.157520] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.157696] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-dca30808-33f5-4d40-bf37-ff5bceaed787 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.157798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.157864] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.158039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.158116] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dca30808-33f5-4d40-bf37-ff5bceaed787',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.173338] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 751.173569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.173928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.174167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.174258] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.618227] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.661732] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.661732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.661732] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dca30808-33f5-4d40-bf37-ff5bceaed787 with status ACTIVE [ 751.661732] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.661732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.661732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.661732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.661732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.661732] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.661732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.661732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.666098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.666098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.666098] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.666098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.666098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.666098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.666098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.666098] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dca30808-33f5-4d40-bf37-ff5bceaed787 is going to be updated. [ 751.667177] env[69499]: INFO networking_nsxv3.common.synchronization [req-6ca66ae5-4d89-4469-a5bd-1fdbcf72910b req-75b812a4-65ed-4acc-82b9-8adcd0008d69 tempest-ServersTestMultiNic-453281866 tempest-ServersTestMultiNic-453281866-project-member] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 751.668194] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 751.668486] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.668587] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.668668] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.668880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.669042] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.669141] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.669200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.669345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.669424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.669511] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.676798] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.676913] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.685375] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.686199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.686320] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.686567] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.686732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.686919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.757020] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 751.757020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.830367] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 751.830367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.086455] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 752.086677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.086858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.087105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.087680] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.087680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.087680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.087680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.087903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.087903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.087967] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.122842] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.173601] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.258589] env[69499]: INFO networking_nsxv3.common.synchronization [req-6ca66ae5-4d89-4469-a5bd-1fdbcf72910b req-54df1df3-65d1-4f05-81d4-6aeb4ac76d99 tempest-ServersTestMultiNic-453281866 tempest-ServersTestMultiNic-453281866-project-member] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 752.259126] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 752.260223] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.260223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.591653] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.591817] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.591898] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.592190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.592597] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.592597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.592597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.592760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.592760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.592828] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.592949] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.593052] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.593138] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.593268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.593442] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.593543] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.593607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.593750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.593983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.593983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.593983] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.625740] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.625740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.625740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.625740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.625968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.625968] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 is going to be updated. [ 752.634266] env[69499]: INFO networking_nsxv3.common.synchronization [req-6ca66ae5-4d89-4469-a5bd-1fdbcf72910b req-99c4aa8d-2dcf-4010-bf43-130b7b1887a4 tempest-ServersTestMultiNic-453281866 tempest-ServersTestMultiNic-453281866-project-member] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 752.635052] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 752.635052] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.635211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.657467] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.660688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.660688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.660688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.660688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.670025] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 in Status: IN_PROGRESS for 2s [ 752.675717] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.699346] env[69499]: INFO networking_nsxv3.common.synchronization [req-ab585eff-7bf0-4eb5-af35-64bd15e409c5 req-1bc16564-504e-4119-8b89-18f3433f7303 tempest-FloatingIPsAssociationTestJSON-1168940114 tempest-FloatingIPsAssociationTestJSON-1168940114-project-member] Enqueued Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_members [ 752.700342] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_members [ 752.700661] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-04847a44-8459-4dcc-b6cd-80a364fba3d0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.700796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.700868] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.701088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.701686] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.701686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.701686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.701686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.701686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.701686] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.096901] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51d37fb6-4b72-4eba-930a-b89442ed8859: rpc.has_security_group_logging(os_id): False [ 753.116585] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.116585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.116585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.116585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.116585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.116585] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.116585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.116585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.116994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.116994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.116994] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.117110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.117152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.118039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.118039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.118039] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.118039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.118039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.118039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.118039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.118459] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 753.177936] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.178318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.178318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.178458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.178687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.180125] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.180272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.180329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.180537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.180656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.180751] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be updated. [ 753.203862] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.205507] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 753.237158] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.237158] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.237279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.237416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.237636] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.256680] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 2s [ 753.707169] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.210195] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.210508] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.210508] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.210650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.210744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.210845] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 is going to be updated. [ 754.265565] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.265721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.265844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.265998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.266157] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.277240] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: IN_PROGRESS for 2s [ 754.480776] env[69499]: INFO networking_nsxv3.common.synchronization [None req-013cf71c-2943-4f98-aacc-7ca1f3a8b17e tempest-ImagesOneServerNegativeTestJSON-1949881093 tempest-ImagesOneServerNegativeTestJSON-1949881093-project-member] Enqueued Resource ID: 64bcc241-6bde-4f9c-8f70-9be18ea2b5f2 with Priority: HIGHEST for action security_group_rules [ 754.480776] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64bcc241-6bde-4f9c-8f70-9be18ea2b5f2 with Priority: HIGHEST for action security_group_rules [ 754.480859] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64bcc241-6bde-4f9c-8f70-9be18ea2b5f2 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.480981] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64bcc241-6bde-4f9c-8f70-9be18ea2b5f2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.481045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64bcc241-6bde-4f9c-8f70-9be18ea2b5f2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.481341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64bcc241-6bde-4f9c-8f70-9be18ea2b5f2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.481445] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64bcc241-6bde-4f9c-8f70-9be18ea2b5f2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.515151] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f8cc9fb-5ec8-4a99-b8ba-e526e14d6b0b req-951ad65b-7215-4d5a-a9d9-f98e7361f60b tempest-ListServersNegativeTestJSON-163043732 tempest-ListServersNegativeTestJSON-163043732-project-member] Enqueued Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 754.515703] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 754.516488] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.516488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.516488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.516488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.516760] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.516760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.516760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.517211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.517306] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.517404] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.579261] env[69499]: INFO networking_nsxv3.common.synchronization [None req-1a33af57-d381-4c7e-b72b-4a1cfeff84d6 tempest-ImagesOneServerNegativeTestJSON-1949881093 tempest-ImagesOneServerNegativeTestJSON-1949881093-project-member] Enqueued Resource ID: 64bcc241-6bde-4f9c-8f70-9be18ea2b5f2 with Priority: HIGHEST for action security_group_rules [ 754.579881] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64bcc241-6bde-4f9c-8f70-9be18ea2b5f2 with Priority: HIGHEST for action security_group_rules [ 754.580326] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64bcc241-6bde-4f9c-8f70-9be18ea2b5f2 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.580469] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64bcc241-6bde-4f9c-8f70-9be18ea2b5f2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.681033] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 in Status: SUCCESS [ 754.681033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.681033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.681033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.681033] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.681033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.681033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.681033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.681033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.681033] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.950140] env[69499]: INFO networking_nsxv3.common.synchronization [req-602a94d3-b7eb-4b2e-9dc1-91023e8a75f0 req-11102aaa-f838-4a9a-ad97-2cf522640d5f tempest-AttachInterfacesUnderV243Test-812043974 tempest-AttachInterfacesUnderV243Test-812043974-project-member] Enqueued Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_members [ 754.951424] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_members [ 754.952342] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.952903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.976924] env[69499]: INFO networking_nsxv3.common.synchronization [req-602a94d3-b7eb-4b2e-9dc1-91023e8a75f0 req-11102aaa-f838-4a9a-ad97-2cf522640d5f tempest-AttachInterfacesUnderV243Test-812043974 tempest-AttachInterfacesUnderV243Test-812043974-project-member] Enqueued Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_rules [ 754.976924] env[69499]: INFO networking_nsxv3.common.synchronization [req-602a94d3-b7eb-4b2e-9dc1-91023e8a75f0 req-11102aaa-f838-4a9a-ad97-2cf522640d5f tempest-AttachInterfacesUnderV243Test-812043974 tempest-AttachInterfacesUnderV243Test-812043974-project-member] Enqueued Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_members [ 754.977109] env[69499]: INFO networking_nsxv3.common.synchronization [req-602a94d3-b7eb-4b2e-9dc1-91023e8a75f0 req-11102aaa-f838-4a9a-ad97-2cf522640d5f tempest-AttachInterfacesUnderV243Test-812043974 tempest-AttachInterfacesUnderV243Test-812043974-project-member] Enqueued Resource ID: dca30808-33f5-4d40-bf37-ff5bceaed787 with Priority: HIGHEST for action port [ 754.978251] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_rules [ 754.978251] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_members [ 754.978382] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dca30808-33f5-4d40-bf37-ff5bceaed787 with Priority: HIGHEST for action port [ 754.978911] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.978911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.978911] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.979219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.979700] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-dca30808-33f5-4d40-bf37-ff5bceaed787 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.979700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.980038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.980601] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.980601] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dca30808-33f5-4d40-bf37-ff5bceaed787',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.000971] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.001446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.001614] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.001898] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.003369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.003369] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64bcc241-6bde-4f9c-8f70-9be18ea2b5f2 already deleted. [ 755.003369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64bcc241-6bde-4f9c-8f70-9be18ea2b5f2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.003369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64bcc241-6bde-4f9c-8f70-9be18ea2b5f2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.003369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64bcc241-6bde-4f9c-8f70-9be18ea2b5f2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.003369] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64bcc241-6bde-4f9c-8f70-9be18ea2b5f2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.020577] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.022362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.022362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.022362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.022362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.022362] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.022362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.022362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.022362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.022362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.022362] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3283bfac-7979-4949-ab5e-93112edbbd0b already deleted. [ 755.022362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.089810] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.089810] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-435" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.089810] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-435" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.089810] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-435" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.091268] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.091588] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.091849] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.092230] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.093050] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.093050] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 755.093050] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.093050] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.093258] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.093258] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 755.093329] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.093482] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.114336] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.115638] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 755.115638] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.115638] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-435" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.115638] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-44eb5637-90a8-409f-b763-f1798c4e582b taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.115638] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-44eb5637-90a8-409f-b763-f1798c4e582b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.115919] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-44eb5637-90a8-409f-b763-f1798c4e582b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.116171] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-44eb5637-90a8-409f-b763-f1798c4e582b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.117602] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44eb5637-90a8-409f-b763-f1798c4e582b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.182822] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.223803] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 755.224819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.268132] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 755.268132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.268132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.268132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.268132] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.268132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.268132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.268132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.268132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.268132] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.483165] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dca30808-33f5-4d40-bf37-ff5bceaed787 with status ACTIVE [ 755.483411] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.483547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.483629] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.483840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.483942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.484158] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.484260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.484311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.484576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.484671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.484795] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.484891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.485007] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.485105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.485241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.485299] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dca30808-33f5-4d40-bf37-ff5bceaed787 is going to be updated. [ 755.524792] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.524792] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.524792] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.525128] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.525747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.525747] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64bcc241-6bde-4f9c-8f70-9be18ea2b5f2 already deleted. [ 755.525747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64bcc241-6bde-4f9c-8f70-9be18ea2b5f2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.530107] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.530107] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.530107] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.530107] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.530107] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.530107] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dca30808-33f5-4d40-bf37-ff5bceaed787" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.619631] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.619893] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.620046] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.620332] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.620487] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.620647] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 44eb5637-90a8-409f-b763-f1798c4e582b not found, creating... [ 755.620954] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.621063] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.621184] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.621412] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.621584] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.621849] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.622009] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.625552] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.625803] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.625948] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.626132] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 44eb5637-90a8-409f-b763-f1798c4e582b is going to be created. [ 755.654009] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.654235] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.654364] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.654650] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.654880] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.655114] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-44eb5637-90a8-409f-b763-f1798c4e582b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.685631] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.771499] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.771724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.771829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.772061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.772160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.772356] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.772450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.772507] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.772658] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.772735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.772818] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be updated. [ 755.807326] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.807326] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.807326] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.807326] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.807326] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.816059] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 2s [ 756.188113] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.188302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.188378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.189757] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.189757] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.189757] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 is going to be updated. [ 756.227817] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.229403] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.229403] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.229757] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.230761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.240782] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 in Status: IN_PROGRESS for 2s [ 756.286339] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: SUCCESS [ 756.286557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.496159] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f8cc9fb-5ec8-4a99-b8ba-e526e14d6b0b req-df883d46-7146-4e04-b54c-2eb8a9601e89 service nova] Enqueued Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_rules [ 756.496343] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f8cc9fb-5ec8-4a99-b8ba-e526e14d6b0b req-df883d46-7146-4e04-b54c-2eb8a9601e89 service nova] Enqueued Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 756.496481] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f8cc9fb-5ec8-4a99-b8ba-e526e14d6b0b req-df883d46-7146-4e04-b54c-2eb8a9601e89 service nova] Enqueued Resource ID: 44eb5637-90a8-409f-b763-f1798c4e582b with Priority: HIGHEST for action port [ 756.496712] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_rules [ 756.496843] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 756.496949] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44eb5637-90a8-409f-b763-f1798c4e582b with Priority: HIGHEST for action port [ 756.497477] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.497641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.497746] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.497929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.498048] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.498846] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.498953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.499033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.499208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.500092] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.500206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.500274] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.500427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.500515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.500657] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.501921] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-44eb5637-90a8-409f-b763-f1798c4e582b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.502040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44eb5637-90a8-409f-b763-f1798c4e582b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.502110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44eb5637-90a8-409f-b763-f1798c4e582b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.502262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44eb5637-90a8-409f-b763-f1798c4e582b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.502339] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44eb5637-90a8-409f-b763-f1798c4e582b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.010555] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.010555] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.010555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.011923] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44eb5637-90a8-409f-b763-f1798c4e582b with status ACTIVE [ 757.012310] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.012585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.012930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.013267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.013403] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.013703] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.014826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.014826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.014826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.014826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.014826] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.016288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.016288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.016288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.016288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.016288] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44eb5637-90a8-409f-b763-f1798c4e582b is going to be updated. [ 757.040325] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.040325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.040325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.040325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.040325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.040325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44eb5637-90a8-409f-b763-f1798c4e582b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.316165] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f8cc9fb-5ec8-4a99-b8ba-e526e14d6b0b req-dbd6dca9-fa6d-4b9c-8665-847716c3ade9 tempest-ListServersNegativeTestJSON-163043732 tempest-ListServersNegativeTestJSON-163043732-project-member] Enqueued Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 757.317372] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 757.317944] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.317944] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.508723] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.807735] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.807937] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-435" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.808110] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-435" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.808388] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-435" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.808713] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.808874] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.808989] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.809226] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.809363] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.809570] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.810274] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.810274] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.810274] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.810274] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.810274] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.810274] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.825461] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 757.825645] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 deletion is rescheduled due to dependency. [ 757.825750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.825901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.826111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.826274] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.826379] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.826442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.826582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.826662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.826755] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.832879] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.832879] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 757.832879] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.832879] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-435" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.832879] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-a820ece7-07f6-408c-87ab-f8d7d5308d3e taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.832879] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-a820ece7-07f6-408c-87ab-f8d7d5308d3e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.832879] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-a820ece7-07f6-408c-87ab-f8d7d5308d3e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.832879] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-a820ece7-07f6-408c-87ab-f8d7d5308d3e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.832879] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a820ece7-07f6-408c-87ab-f8d7d5308d3e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.011411] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.011591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.011701] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.012017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.012080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.012224] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3283bfac-7979-4949-ab5e-93112edbbd0b is going to be created. [ 758.032963] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.033188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.033300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.033537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.033716] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.041502] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: UNINITIALIZED for 2s [ 758.253037] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 in Status: SUCCESS [ 758.253037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.253037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.253037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.253037] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.253037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.253037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.253429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.253429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.253429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.253429] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.254253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.254414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.254799] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.254799] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.254799] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.255027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.255027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.255094] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.328754] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.329034] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.329078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.329351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.331021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.331021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.331021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.331021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.331021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.331021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.331021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be updated. [ 758.335160] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.335284] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.335411] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.335651] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.335788] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.335929] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port a820ece7-07f6-408c-87ab-f8d7d5308d3e not found, creating... [ 758.336411] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.336641] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.336765] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.336979] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.337126] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.339012] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.339012] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.339012] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.339012] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.339012] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.339012] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: a820ece7-07f6-408c-87ab-f8d7d5308d3e is going to be created. [ 758.360215] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.360415] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.360536] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.362976] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.363291] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.363464] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-a820ece7-07f6-408c-87ab-f8d7d5308d3e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.365627] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.365789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.365857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.367114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.367114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.374534] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 2s [ 758.522744] env[69499]: INFO networking_nsxv3.common.synchronization [req-17c71812-cf31-49e1-bd61-4789b8e1a072 req-53afb3bd-14a2-4f64-a082-cfc526923070 tempest-AttachInterfacesUnderV243Test-812043974 tempest-AttachInterfacesUnderV243Test-812043974-project-member] Enqueued Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_members [ 758.523320] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 with Priority: HIGHEST for action security_group_members [ 758.523845] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.524295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.758999] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.760026] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.181291] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f8cc9fb-5ec8-4a99-b8ba-e526e14d6b0b req-0cc4ebba-cad0-460a-a199-452bc5682d54 service nova] Enqueued Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_rules [ 759.181463] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f8cc9fb-5ec8-4a99-b8ba-e526e14d6b0b req-0cc4ebba-cad0-460a-a199-452bc5682d54 service nova] Enqueued Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 759.181637] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f8cc9fb-5ec8-4a99-b8ba-e526e14d6b0b req-0cc4ebba-cad0-460a-a199-452bc5682d54 service nova] Enqueued Resource ID: a820ece7-07f6-408c-87ab-f8d7d5308d3e with Priority: HIGHEST for action port [ 759.182276] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_rules [ 759.182399] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 759.182496] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a820ece7-07f6-408c-87ab-f8d7d5308d3e with Priority: HIGHEST for action port [ 759.182764] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.182868] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.183071] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.183219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.185843] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-a820ece7-07f6-408c-87ab-f8d7d5308d3e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.185843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a820ece7-07f6-408c-87ab-f8d7d5308d3e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.185843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a820ece7-07f6-408c-87ab-f8d7d5308d3e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.185843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a820ece7-07f6-408c-87ab-f8d7d5308d3e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.185843] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a820ece7-07f6-408c-87ab-f8d7d5308d3e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.261411] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.262270] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870: rpc.has_security_group_logging(os_id): False [ 759.281546] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.281693] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.281739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.281928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.301731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.301976] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.302105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.302170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.302342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.302426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.302518] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 is going to be updated. [ 759.362532] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.362802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.362802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.362938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.363102] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.374492] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 in Status: IN_PROGRESS for 2s [ 759.686391] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a820ece7-07f6-408c-87ab-f8d7d5308d3e with status ACTIVE [ 759.686617] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.686853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.686923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.687143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.687231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.687410] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.687504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.687642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.687775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.687883] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.688036] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.688128] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.688185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.688319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.688390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.688470] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a820ece7-07f6-408c-87ab-f8d7d5308d3e is going to be updated. [ 759.707255] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.707400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.707439] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.707679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.707801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.707953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a820ece7-07f6-408c-87ab-f8d7d5308d3e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.764696] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.764852] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.764921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.765150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.765245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.765343] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 is going to be updated. [ 759.805249] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.805632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.805632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.805749] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.805788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.813563] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 in Status: IN_PROGRESS for 2s [ 759.818650] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f8cc9fb-5ec8-4a99-b8ba-e526e14d6b0b req-071c0b1b-87e4-4c17-9899-707230994e42 tempest-ListServersNegativeTestJSON-163043732 tempest-ListServersNegativeTestJSON-163043732-project-member] Enqueued Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 759.818893] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 759.819430] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.819531] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.055172] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: SUCCESS [ 760.055172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.055172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.055172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.055172] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.055172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.055172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.055172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.055172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.055172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.055172] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.055662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.055662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.055662] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.055761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.055761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.056190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.056190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.057310] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.199206] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.199408] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-435" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.199529] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-435" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.199831] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-435" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.200113] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.200272] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.200395] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.200605] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.200781] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.200935] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 760.201526] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.204043] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.204205] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.204332] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 760.204444] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.204581] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.244927] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.245590] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 760.246633] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.246824] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-435" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.247233] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.248449] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.248645] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.249030] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.249236] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.385672] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 760.385672] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 deletion is rescheduled due to dependency. [ 760.385672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.558604] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.558746] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.561339] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.752878] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.753206] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.753380] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.753742] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.753926] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.754130] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f not found, creating... [ 760.754512] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.754736] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.754936] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.755251] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.755440] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.755852] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.756832] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.757088] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.757401] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.757552] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.757723] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f is going to be created. [ 760.778315] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.779038] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.779038] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.779329] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.779574] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.779814] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.063745] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.387674] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 in Status: SUCCESS [ 761.387931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.388095] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.388727] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.388727] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.449218] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f8cc9fb-5ec8-4a99-b8ba-e526e14d6b0b req-65d6b57f-024e-4a3e-baee-538ee8891114 service nova] Enqueued Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_rules [ 761.449388] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f8cc9fb-5ec8-4a99-b8ba-e526e14d6b0b req-65d6b57f-024e-4a3e-baee-538ee8891114 service nova] Enqueued Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 761.449524] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f8cc9fb-5ec8-4a99-b8ba-e526e14d6b0b req-65d6b57f-024e-4a3e-baee-538ee8891114 service nova] Enqueued Resource ID: 7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f with Priority: HIGHEST for action port [ 761.449754] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_rules [ 761.449872] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 761.449963] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f with Priority: HIGHEST for action port [ 761.450539] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.450609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.450783] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.450894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.451035] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.451130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.451192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.451385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.451459] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.570148] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.570318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.570538] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.570598] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.570661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.570751] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3283bfac-7979-4949-ab5e-93112edbbd0b is going to be updated. [ 761.597480] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.597480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.597480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.597480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.597480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.604524] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: IN_PROGRESS for 2s [ 761.822542] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 in Status: SUCCESS [ 761.822771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.822948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.823180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.823368] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.823484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.823553] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.823721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.823810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.823904] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.911073] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.911226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.911342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.911503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.911597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.911805] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 is going to be deleted. [ 761.955154] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f with status ACTIVE [ 761.955481] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.955744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.955818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.956209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.956361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.956667] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.956833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.956942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.957199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.957339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.957630] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.957827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.957925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.959188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.959188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.959188] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f is going to be updated. [ 761.960684] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.960848] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.960953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.961208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.961347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.961556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.983691] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.983905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.983905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.984141] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.984291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.984458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c9ded69-25c9-4ea8-b2a9-3850f5c2c98f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.331337] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.331337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.331337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.331337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.331337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.331337] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.331337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.331337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.331337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.331337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.331337] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 is going to be deleted. [ 762.358592] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.358744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.358818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.359239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.359239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.359239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.359380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.359612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.359690] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.359783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.359846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.359987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.360075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.360189] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.497219] env[69499]: INFO networking_nsxv3.common.synchronization [req-4c7c4b07-c8b6-474d-8a2e-27f89a6266dc req-66e35e15-e932-4361-aee8-87362a4a570b tempest-MultipleCreateTestJSON-19272315 tempest-MultipleCreateTestJSON-19272315-project-member] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 762.498338] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 762.498338] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.498338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.498338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.498709] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.498709] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.498709] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.498825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.498968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.498968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.499551] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.840095] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.840236] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.840383] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.840623] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.840855] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.841044] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.841263] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.841512] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.842073] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.842073] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.842073] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.842312] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.842903] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.842903] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.842903] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.842903] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.862525] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.862747] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 762.862896] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.863077] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.863383] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-a279fc24-1735-4144-9dec-69e69d3bb78c taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.863583] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-a279fc24-1735-4144-9dec-69e69d3bb78c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.863701] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-a279fc24-1735-4144-9dec-69e69d3bb78c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.864039] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-a279fc24-1735-4144-9dec-69e69d3bb78c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.864179] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a279fc24-1735-4144-9dec-69e69d3bb78c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.865138] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.865295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.865365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.865556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.865635] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.865813] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.865897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.865952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.866170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.866170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.866265] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870 already deleted. [ 762.866315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2bdd2c-40f8-4e37-a1e1-7864ccc2e870" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.004848] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.005157] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.005286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.006205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.025950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.026507] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.026596] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.026641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.026921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.027068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.028045] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be updated. [ 763.049681] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.049903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.049981] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.050930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.050930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.059646] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: IN_PROGRESS for 2s [ 763.370928] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.375060] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.375060] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.375060] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.375060] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.375060] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port a279fc24-1735-4144-9dec-69e69d3bb78c not found, creating... [ 763.375060] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.375060] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.375060] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.375060] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.375060] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.375835] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.375835] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.375835] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.375835] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.375835] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.375835] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: a279fc24-1735-4144-9dec-69e69d3bb78c is going to be created. [ 763.393269] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.393489] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.393609] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.393899] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.394140] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.394368] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-a279fc24-1735-4144-9dec-69e69d3bb78c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.617634] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: SUCCESS [ 763.617930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.618135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.618356] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.618543] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.618686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.618719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.619797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.619797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.619797] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.104935] env[69499]: INFO networking_nsxv3.common.synchronization [req-4c7c4b07-c8b6-474d-8a2e-27f89a6266dc req-3ec82f3c-c6b4-49f1-bae7-46055578d268 service nova] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_rules [ 764.105139] env[69499]: INFO networking_nsxv3.common.synchronization [req-4c7c4b07-c8b6-474d-8a2e-27f89a6266dc req-3ec82f3c-c6b4-49f1-bae7-46055578d268 service nova] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 764.105278] env[69499]: INFO networking_nsxv3.common.synchronization [req-4c7c4b07-c8b6-474d-8a2e-27f89a6266dc req-3ec82f3c-c6b4-49f1-bae7-46055578d268 service nova] Enqueued Resource ID: a279fc24-1735-4144-9dec-69e69d3bb78c with Priority: HIGHEST for action port [ 764.105515] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_rules [ 764.105675] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 764.105780] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a279fc24-1735-4144-9dec-69e69d3bb78c with Priority: HIGHEST for action port [ 764.106395] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.106526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.106595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.106791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.106871] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.108040] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.108040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.108040] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-a279fc24-1735-4144-9dec-69e69d3bb78c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.108382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a279fc24-1735-4144-9dec-69e69d3bb78c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.108382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a279fc24-1735-4144-9dec-69e69d3bb78c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.108382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a279fc24-1735-4144-9dec-69e69d3bb78c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.108382] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a279fc24-1735-4144-9dec-69e69d3bb78c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.121430] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.610624] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.610624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.610805] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a279fc24-1735-4144-9dec-69e69d3bb78c with status ACTIVE [ 764.611607] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.611607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.611607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.611607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.611607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.611607] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.611881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.611881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.611881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.611995] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.612235] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.612235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.612340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.612430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.612505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.612615] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a279fc24-1735-4144-9dec-69e69d3bb78c is going to be updated. [ 764.615150] env[69499]: INFO networking_nsxv3.common.synchronization [req-76d4add4-7c60-4584-8d28-7835d8bf9b40 req-08462724-bbcf-4e33-9f02-47e2d1955f86 tempest-ServersTestFqdnHostnames-969656061 tempest-ServersTestFqdnHostnames-969656061-project-member] Enqueued Resource ID: a240c519-0037-4bca-bd0c-b35068bcd700 with Priority: HIGHEST for action security_group_members [ 764.615828] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a240c519-0037-4bca-bd0c-b35068bcd700 with Priority: HIGHEST for action security_group_members [ 764.617489] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a240c519-0037-4bca-bd0c-b35068bcd700 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.617623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.617686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.617922] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.617971] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.618078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.618377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.618377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.618377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.618509] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a240c519-0037-4bca-bd0c-b35068bcd700',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.623166] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.634411] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.634550] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.634618] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.634813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.634943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.635325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a279fc24-1735-4144-9dec-69e69d3bb78c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.068225] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: SUCCESS [ 765.068414] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae deletion is rescheduled due to dependency. [ 765.068529] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.069071] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.069589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.069589] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.069738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.069738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.069908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.070036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.070137] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.121293] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.121293] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.121293] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.121293] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.125216] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.125363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.125363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.125729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.125885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.125998] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3283bfac-7979-4949-ab5e-93112edbbd0b is going to be updated. [ 765.142181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.142393] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.142470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.142470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.142706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.142777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.142863] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a240c519-0037-4bca-bd0c-b35068bcd700 is going to be updated. [ 765.160595] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.160743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.160817] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.161063] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.161215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.169549] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: IN_PROGRESS for 2s [ 765.171978] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.171978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.171978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.171978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.171978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.178062] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a240c519-0037-4bca-bd0c-b35068bcd700 in Status: IN_PROGRESS for 2s [ 765.365743] env[69499]: INFO networking_nsxv3.common.synchronization [req-4c7c4b07-c8b6-474d-8a2e-27f89a6266dc req-1ec0b320-9a18-4207-8fa3-b849cbc317dc tempest-MultipleCreateTestJSON-19272315 tempest-MultipleCreateTestJSON-19272315-project-member] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 765.366752] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 765.367198] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.367441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.573272] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.723879] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.724211] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.724211] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.724485] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.724750] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.724908] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.725106] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.725341] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.725487] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.725749] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 765.725867] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 765.725977] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 765.726103] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 765.726211] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 765.726316] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 765.726448] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 765.744716] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 765.744982] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 765.745147] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 765.745322] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-780" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.745633] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-61778f0a-b55f-4710-99cc-e6327553129c taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.745829] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-61778f0a-b55f-4710-99cc-e6327553129c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.745981] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-61778f0a-b55f-4710-99cc-e6327553129c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.746322] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-61778f0a-b55f-4710-99cc-e6327553129c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.746459] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61778f0a-b55f-4710-99cc-e6327553129c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.076122] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.249436] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.249774] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.250038] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.250397] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.250633] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.250859] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 61778f0a-b55f-4710-99cc-e6327553129c not found, creating... [ 766.251302] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.251543] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.251717] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.252417] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.252417] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.253851] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.253851] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.253851] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.253851] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.253851] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.253851] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 61778f0a-b55f-4710-99cc-e6327553129c is going to be created. [ 766.276215] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.276515] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.276617] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.276988] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.277340] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.277717] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-61778f0a-b55f-4710-99cc-e6327553129c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.578604] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.579433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.579433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.579433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.579433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.579433] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be updated. [ 766.606978] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.607346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.607427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.607695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.607839] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.615127] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: IN_PROGRESS for 2s [ 767.019710] env[69499]: INFO networking_nsxv3.common.synchronization [req-4c7c4b07-c8b6-474d-8a2e-27f89a6266dc req-043aa6fa-5b6c-4560-8050-8290f0dcd993 service nova] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_rules [ 767.019989] env[69499]: INFO networking_nsxv3.common.synchronization [req-4c7c4b07-c8b6-474d-8a2e-27f89a6266dc req-043aa6fa-5b6c-4560-8050-8290f0dcd993 service nova] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 767.020114] env[69499]: INFO networking_nsxv3.common.synchronization [req-4c7c4b07-c8b6-474d-8a2e-27f89a6266dc req-043aa6fa-5b6c-4560-8050-8290f0dcd993 service nova] Enqueued Resource ID: 61778f0a-b55f-4710-99cc-e6327553129c with Priority: HIGHEST for action port [ 767.020547] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_rules [ 767.020753] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 767.020792] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61778f0a-b55f-4710-99cc-e6327553129c with Priority: HIGHEST for action port [ 767.022394] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.022541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.022791] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.022928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.023096] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-61778f0a-b55f-4710-99cc-e6327553129c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.023236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61778f0a-b55f-4710-99cc-e6327553129c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.023279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61778f0a-b55f-4710-99cc-e6327553129c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.023454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61778f0a-b55f-4710-99cc-e6327553129c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.023532] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61778f0a-b55f-4710-99cc-e6327553129c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.179176] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: SUCCESS [ 767.179462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.180741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.180977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.181257] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.181759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.181759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.181759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.181759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.181981] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.189687] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a240c519-0037-4bca-bd0c-b35068bcd700 in Status: SUCCESS [ 767.190325] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a240c519-0037-4bca-bd0c-b35068bcd700 deletion is rescheduled due to dependency. [ 767.190325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.525526] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61778f0a-b55f-4710-99cc-e6327553129c with status ACTIVE [ 767.525879] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.526045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.526119] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.526330] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.526426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.526607] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.526708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.526778] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.526930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.527015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.527270] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.527329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.527380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.527552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.527636] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.527731] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61778f0a-b55f-4710-99cc-e6327553129c is going to be updated. [ 767.547868] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.548030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.548090] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.548284] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.548413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.548567] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61778f0a-b55f-4710-99cc-e6327553129c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.684183] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.965519] env[69499]: INFO networking_nsxv3.common.synchronization [req-52e1dedf-55bd-4db8-b991-8f75ffaf06a0 req-efc27cd6-acdb-4570-9d76-15c41bc0844c tempest-ServersTestJSON-1975233753 tempest-ServersTestJSON-1975233753-project-member] Enqueued Resource ID: ffce52a9-70af-448f-a2c4-9791dde804d4 with Priority: HIGHEST for action security_group_members [ 767.966156] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffce52a9-70af-448f-a2c4-9791dde804d4 with Priority: HIGHEST for action security_group_members [ 767.966490] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffce52a9-70af-448f-a2c4-9791dde804d4 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.966637] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.966733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.967070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.967289] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.967396] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.967462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.967669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.968106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.968106] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffce52a9-70af-448f-a2c4-9791dde804d4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.187210] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.374023] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-896 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.374023] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-896" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.374023] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-896" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.374023] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-896" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.374023] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.374023] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.374023] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.374791] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.375066] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.375377] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.375619] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.375895] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.376116] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.376348] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.376614] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.376906] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.398732] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.398732] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 768.398732] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.398732] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-896" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.398732] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-45131ff0-70a0-4cfb-bbe4-97ba02cbafb4 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.398732] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-45131ff0-70a0-4cfb-bbe4-97ba02cbafb4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.398732] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-45131ff0-70a0-4cfb-bbe4-97ba02cbafb4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.398732] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-45131ff0-70a0-4cfb-bbe4-97ba02cbafb4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.398732] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45131ff0-70a0-4cfb-bbe4-97ba02cbafb4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.469997] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.470177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.470247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.470466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.470552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.470748] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.470837] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.470896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.471054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.471127] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.471209] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffce52a9-70af-448f-a2c4-9791dde804d4 already deleted. [ 768.471284] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.626842] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: SUCCESS [ 768.627394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.627394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.627510] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.627866] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.627866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.627866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.629765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.629765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.629765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.629765] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.630292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.631919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.632127] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.632271] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.632346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.632492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.632851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.632851] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.690034] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.690318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.690318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.690509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.690623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.690768] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3283bfac-7979-4949-ab5e-93112edbbd0b is going to be updated. [ 768.719998] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.720156] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.720216] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.720438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.720584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.733276] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: IN_PROGRESS for 2s [ 768.904283] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.904715] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.904856] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.905174] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.905295] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.905556] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 45131ff0-70a0-4cfb-bbe4-97ba02cbafb4 not found, creating... [ 768.905821] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.906097] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.906165] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.906381] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.906527] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.906823] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.906979] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.907162] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.907363] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.907493] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.907756] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 45131ff0-70a0-4cfb-bbe4-97ba02cbafb4 is going to be created. [ 768.927279] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.927422] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.927552] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.927977] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.928325] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.928576] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-45131ff0-70a0-4cfb-bbe4-97ba02cbafb4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.130794] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.130980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.136461] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.639305] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.706843] env[69499]: INFO networking_nsxv3.common.synchronization [req-52e1dedf-55bd-4db8-b991-8f75ffaf06a0 req-5d3d977a-24c0-4f11-b683-e3d5d9ccf4f0 service nova] Enqueued Resource ID: ffce52a9-70af-448f-a2c4-9791dde804d4 with Priority: HIGHEST for action security_group_rules [ 769.707157] env[69499]: INFO networking_nsxv3.common.synchronization [req-52e1dedf-55bd-4db8-b991-8f75ffaf06a0 req-5d3d977a-24c0-4f11-b683-e3d5d9ccf4f0 service nova] Enqueued Resource ID: ffce52a9-70af-448f-a2c4-9791dde804d4 with Priority: HIGHEST for action security_group_members [ 769.707324] env[69499]: INFO networking_nsxv3.common.synchronization [req-52e1dedf-55bd-4db8-b991-8f75ffaf06a0 req-5d3d977a-24c0-4f11-b683-e3d5d9ccf4f0 service nova] Enqueued Resource ID: 45131ff0-70a0-4cfb-bbe4-97ba02cbafb4 with Priority: HIGHEST for action port [ 769.707980] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffce52a9-70af-448f-a2c4-9791dde804d4 with Priority: HIGHEST for action security_group_rules [ 769.708128] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffce52a9-70af-448f-a2c4-9791dde804d4 with Priority: HIGHEST for action security_group_members [ 769.711018] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45131ff0-70a0-4cfb-bbe4-97ba02cbafb4 with Priority: HIGHEST for action port [ 769.711018] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffce52a9-70af-448f-a2c4-9791dde804d4 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.711018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.711018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.711018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.711018] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffce52a9-70af-448f-a2c4-9791dde804d4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.711018] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffce52a9-70af-448f-a2c4-9791dde804d4 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.711363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.711363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.711363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.711481] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.711549] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.711608] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.711805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.711805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.711949] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffce52a9-70af-448f-a2c4-9791dde804d4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.720022] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-45131ff0-70a0-4cfb-bbe4-97ba02cbafb4 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.720022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45131ff0-70a0-4cfb-bbe4-97ba02cbafb4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.720022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45131ff0-70a0-4cfb-bbe4-97ba02cbafb4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.720022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45131ff0-70a0-4cfb-bbe4-97ba02cbafb4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.720022] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45131ff0-70a0-4cfb-bbe4-97ba02cbafb4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.141633] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.141813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.141902] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.142125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.142231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.142335] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be updated. [ 770.170205] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.170393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.170460] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.170634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.170783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.179578] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: IN_PROGRESS for 2s [ 770.219157] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffce52a9-70af-448f-a2c4-9791dde804d4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.220165] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffce52a9-70af-448f-a2c4-9791dde804d4 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.220293] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.220691] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45131ff0-70a0-4cfb-bbe4-97ba02cbafb4 with status ACTIVE [ 770.220792] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.220900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.220965] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.221181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.221268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.221432] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.221528] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.221590] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.221744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.221892] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.221993] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.224357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.224357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.224357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.224357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.224357] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45131ff0-70a0-4cfb-bbe4-97ba02cbafb4 is going to be updated. [ 770.246045] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.246207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.246287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.246476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.246607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.246761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45131ff0-70a0-4cfb-bbe4-97ba02cbafb4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.654187] env[69499]: INFO networking_nsxv3.common.synchronization [None req-5d39552f-9478-4150-a64b-a5ae2c40c135 None None] Enqueued Resource ID: 6b6d541e-7146-437e-9dae-8ef9dba384a6 with Priority: HIGHEST for action port [ 770.654187] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b6d541e-7146-437e-9dae-8ef9dba384a6 with Priority: HIGHEST for action port [ 770.662410] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b6d541e-7146-437e-9dae-8ef9dba384a6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.662477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b6d541e-7146-437e-9dae-8ef9dba384a6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.662589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b6d541e-7146-437e-9dae-8ef9dba384a6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.662842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b6d541e-7146-437e-9dae-8ef9dba384a6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.662924] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b6d541e-7146-437e-9dae-8ef9dba384a6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.714368] env[69499]: INFO networking_nsxv3.common.synchronization [req-2d95f00d-763c-4752-87a4-bac201073317 req-87999a29-acfb-4b12-bcd9-b1914c364077 tempest-MigrationsAdminTest-725814107 tempest-MigrationsAdminTest-725814107-project-member] Enqueued Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_members [ 770.715180] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_members [ 770.715842] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.716197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.716338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.718106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.718106] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.718106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.718106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.718106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.718106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.718106] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.721855] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffce52a9-70af-448f-a2c4-9791dde804d4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.743616] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: SUCCESS [ 770.743844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.744291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.744553] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.744683] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.744840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.744880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.745227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.745227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.745227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.745334] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.745424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.745459] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.745639] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.745752] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.746107] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.746203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.746351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.746420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.746505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.747209] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.747450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.747622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.747825] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.747950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.748033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.748168] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.748244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.748328] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.165747] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b6d541e-7146-437e-9dae-8ef9dba384a6 [ 771.165993] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.166174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.166250] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.166458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.166569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.166640] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b6d541e-7146-437e-9dae-8ef9dba384a6 already deleted. [ 771.166724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b6d541e-7146-437e-9dae-8ef9dba384a6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.169649] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.169767] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.169908] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.170219] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.170504] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.170668] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.170786] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.171278] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.171439] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.171681] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.171798] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.171919] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.172045] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.172307] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.172307] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.172415] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.189816] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.190068] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 771.190237] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.190428] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.190769] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-8b3fa948-a549-4aba-8f71-daafbf52023d taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.190966] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-8b3fa948-a549-4aba-8f71-daafbf52023d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.191115] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-8b3fa948-a549-4aba-8f71-daafbf52023d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.191459] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-8b3fa948-a549-4aba-8f71-daafbf52023d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.191605] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b3fa948-a549-4aba-8f71-daafbf52023d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.219933] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.227753] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.227753] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.227753] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.227753] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.227753] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.227753] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffce52a9-70af-448f-a2c4-9791dde804d4 is going to be created. [ 771.252261] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.253589] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3283bfac-7979-4949-ab5e-93112edbbd0b: rpc.has_security_group_logging(os_id): False [ 771.259869] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.259869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.259869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.259869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.259869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.276899] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffce52a9-70af-448f-a2c4-9791dde804d4 in Status: UNINITIALIZED for 2s [ 771.281042] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.281220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.281276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.281469] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.281558] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.281777] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.281885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.281978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.282131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.282208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.282426] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.282552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.282940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.282940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.282940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.283224] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.283559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.283559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.283559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.283559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.283752] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3283bfac-7979-4949-ab5e-93112edbbd0b is going to be created. [ 771.357236] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.357342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.357587] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.357688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.357887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.371420] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: IN_PROGRESS for 2s [ 771.698241] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.698568] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.698605] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.698880] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.699048] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.699212] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 8b3fa948-a549-4aba-8f71-daafbf52023d not found, creating... [ 771.699479] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.699639] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.699796] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.700146] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.700290] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.700581] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.700737] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.700855] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.702776] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.702995] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.703176] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 8b3fa948-a549-4aba-8f71-daafbf52023d is going to be created. [ 771.722018] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.724018] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.724230] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.724690] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.725010] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.725262] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.725479] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-8b3fa948-a549-4aba-8f71-daafbf52023d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.764821] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.192575] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: SUCCESS [ 772.192575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.192575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.192575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.192575] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.192575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.192575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.192575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.192575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.192575] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.228277] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.228277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.228277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.228416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.232020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.232020] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c is going to be updated. [ 772.268025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.268025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.268025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.268025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.268025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.268917] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.268917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.268917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.269921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.270159] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.270279] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3283bfac-7979-4949-ab5e-93112edbbd0b is going to be updated. [ 772.286405] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: IN_PROGRESS for 2s [ 772.303992] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.304209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.304209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.304451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.304598] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.317023] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: IN_PROGRESS for 2s [ 772.611851] env[69499]: INFO networking_nsxv3.common.synchronization [req-2d95f00d-763c-4752-87a4-bac201073317 req-5ac590c4-f5d1-41db-b34d-a83d0ffd019e service nova] Enqueued Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_rules [ 772.612037] env[69499]: INFO networking_nsxv3.common.synchronization [req-2d95f00d-763c-4752-87a4-bac201073317 req-5ac590c4-f5d1-41db-b34d-a83d0ffd019e service nova] Enqueued Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_members [ 772.612174] env[69499]: INFO networking_nsxv3.common.synchronization [req-2d95f00d-763c-4752-87a4-bac201073317 req-5ac590c4-f5d1-41db-b34d-a83d0ffd019e service nova] Enqueued Resource ID: 8b3fa948-a549-4aba-8f71-daafbf52023d with Priority: HIGHEST for action port [ 772.612409] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_rules [ 772.612532] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_members [ 772.612623] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b3fa948-a549-4aba-8f71-daafbf52023d with Priority: HIGHEST for action port [ 772.616012] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.616094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.616137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.616341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.616423] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.618070] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.618070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.618316] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b3fa948-a549-4aba-8f71-daafbf52023d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.618394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b3fa948-a549-4aba-8f71-daafbf52023d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.618432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b3fa948-a549-4aba-8f71-daafbf52023d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.618622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b3fa948-a549-4aba-8f71-daafbf52023d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.618706] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b3fa948-a549-4aba-8f71-daafbf52023d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.694849] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.850388] env[69499]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 772.850388] env[69499]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] NSXv3 Agent Agent loop - iteration:1 started [ 773.119739] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.119889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.122621] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b3fa948-a549-4aba-8f71-daafbf52023d with status ACTIVE [ 773.122870] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.123014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.123096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.123576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.123688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.123890] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.123999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.124114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.124267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.124371] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.124564] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.124704] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.124745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.124867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.124947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.125048] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b3fa948-a549-4aba-8f71-daafbf52023d is going to be updated. [ 773.148056] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.148056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.148056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.148056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.148056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.148056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b3fa948-a549-4aba-8f71-daafbf52023d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.204845] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.290140] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffce52a9-70af-448f-a2c4-9791dde804d4 in Status: SUCCESS [ 773.290140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.290140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.290140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.290140] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.290140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.290140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.290140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.290140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.290140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.290140] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffce52a9-70af-448f-a2c4-9791dde804d4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.348100] env[69499]: INFO networking_nsxv3.common.synchronization [None req-00da08d8-79a5-4178-b262-0b605325ff11 None None] Enqueued Resource ID: 0fb3b451-8134-469e-9dc1-9041ea3ebecd with Priority: HIGHEST for action port [ 773.348256] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fb3b451-8134-469e-9dc1-9041ea3ebecd with Priority: HIGHEST for action port [ 773.348952] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fb3b451-8134-469e-9dc1-9041ea3ebecd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.348952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fb3b451-8134-469e-9dc1-9041ea3ebecd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.348952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fb3b451-8134-469e-9dc1-9041ea3ebecd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.349335] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fb3b451-8134-469e-9dc1-9041ea3ebecd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.349664] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fb3b451-8134-469e-9dc1-9041ea3ebecd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.382334] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: SUCCESS [ 773.382560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.382740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.382970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.383071] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.704356] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.704519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.704661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.704895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.704991] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.705110] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be updated. [ 773.736068] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.736654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.736654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.736654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.736852] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.747276] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: IN_PROGRESS for 2s [ 773.792931] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffce52a9-70af-448f-a2c4-9791dde804d4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.852103] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fb3b451-8134-469e-9dc1-9041ea3ebecd [ 773.854259] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.854259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.854259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.854259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.854259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.854259] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fb3b451-8134-469e-9dc1-9041ea3ebecd already deleted. [ 773.854259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fb3b451-8134-469e-9dc1-9041ea3ebecd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.886311] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.886311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.296370] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffce52a9-70af-448f-a2c4-9791dde804d4: rpc.has_security_group_logging(os_id): False [ 774.298521] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: SUCCESS [ 774.298718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.298891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.299125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.299325] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.299456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.299521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.299679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.299764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.299869] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.316843] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.317027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.317094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.317266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.317354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.317591] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.317715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.317775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.317918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.317996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.318098] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffce52a9-70af-448f-a2c4-9791dde804d4 is going to be created. [ 774.328941] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: SUCCESS [ 774.329167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.329321] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.329504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.329856] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.329856] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.330078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.330078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.330148] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.330217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.330348] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.381163] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.381278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.381331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.381534] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.381718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.392338] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffce52a9-70af-448f-a2c4-9791dde804d4 in Status: IN_PROGRESS for 2s [ 774.461869] env[69499]: INFO networking_nsxv3.common.synchronization [req-c5af62c6-a7f4-45d9-a69f-076d088988a7 req-5d725134-06be-4af5-9b23-08b969777d8a tempest-ListServersNegativeTestJSON-163043732 tempest-ListServersNegativeTestJSON-163043732-project-member] Enqueued Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 774.462528] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 774.462859] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.462986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.463083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.463344] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.464249] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.464410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.465210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.465210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.465210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.465210] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.802747] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.832810] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.832939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.967053] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.308166] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.469290] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.637779] env[69499]: INFO networking_nsxv3.common.synchronization [req-e1c0f956-2337-4427-913b-c42077a8b263 req-8c27c759-bcda-49d2-8f7c-a189b98957eb tempest-ServersWithSpecificFlavorTestJSON-328556625 tempest-ServersWithSpecificFlavorTestJSON-328556625-project-member] Enqueued Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_members [ 775.638308] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_members [ 775.639179] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8579ac1e-c68a-42fa-957e-e205942d2fbc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.639179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.639179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.639179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.639179] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.639523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.639523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.639523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.639623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.639623] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.756930] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: SUCCESS [ 775.757419] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.757808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.758169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.758501] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.758783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.759969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.759969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.759969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.759969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.759969] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.759969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.759969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.759969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.759969] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.760581] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.761905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.761905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.761905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.761905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.761905] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.816190] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.816190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.816190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.816190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.816190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.816190] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c is going to be updated. [ 775.837880] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.838058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.838099] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.838389] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.838580] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.848115] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: IN_PROGRESS for 2s [ 775.974272] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.974272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.974272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.974272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.974272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.974272] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3283bfac-7979-4949-ab5e-93112edbbd0b is going to be updated. [ 776.004913] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.004913] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.004913] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.004913] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.004913] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.012814] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: IN_PROGRESS for 2s [ 776.072511] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.072709] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-403" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.072836] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-403" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.073561] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-403" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.073561] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.073561] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.073750] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.073869] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.074120] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.074243] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.074357] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.074467] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.074576] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.074686] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.074793] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.074951] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.092641] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.092802] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 776.092941] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.093187] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-403" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.094613] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-942be907-3c05-4417-ab20-76489bce3042 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.094613] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-942be907-3c05-4417-ab20-76489bce3042" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.094613] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-942be907-3c05-4417-ab20-76489bce3042" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.094613] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-942be907-3c05-4417-ab20-76489bce3042" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.094613] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('942be907-3c05-4417-ab20-76489bce3042',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.141800] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.141935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.142048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.142248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.163902] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.164176] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.164300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.164369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.164570] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.164652] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.164746] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc is going to be updated. [ 776.210086] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.210086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.210086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.210086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.210086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.222848] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc in Status: IN_PROGRESS for 2s [ 776.266688] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae: rpc.has_security_group_logging(os_id): False [ 776.285020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.285020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.285020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.285020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.285020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.285020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.285020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.285020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.285020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.285020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.285020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.285020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.285020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.285020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.285020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.285814] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.285814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.285814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.285814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.285814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.286555] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be updated. [ 776.362309] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.362309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.362309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.362309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.362309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.383132] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: IN_PROGRESS for 2s [ 776.410161] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffce52a9-70af-448f-a2c4-9791dde804d4 in Status: SUCCESS [ 776.410161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.599019] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.599019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.599019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.599019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.599019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.599019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 942be907-3c05-4417-ab20-76489bce3042 not found, creating... [ 776.599019] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.599019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.599019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.599019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.599019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.599461] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.599757] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.600045] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.600406] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.600681] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.600973] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 942be907-3c05-4417-ab20-76489bce3042 is going to be created. [ 776.622340] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.622340] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.622340] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.622340] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.622340] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.622340] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-942be907-3c05-4417-ab20-76489bce3042" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.448602] env[69499]: INFO networking_nsxv3.common.synchronization [req-e1c0f956-2337-4427-913b-c42077a8b263 req-ae34af84-b358-436d-bdcd-281710f44974 service nova] Enqueued Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_rules [ 777.448602] env[69499]: INFO networking_nsxv3.common.synchronization [req-e1c0f956-2337-4427-913b-c42077a8b263 req-ae34af84-b358-436d-bdcd-281710f44974 service nova] Enqueued Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_members [ 777.448602] env[69499]: INFO networking_nsxv3.common.synchronization [req-e1c0f956-2337-4427-913b-c42077a8b263 req-ae34af84-b358-436d-bdcd-281710f44974 service nova] Enqueued Resource ID: 942be907-3c05-4417-ab20-76489bce3042 with Priority: HIGHEST for action port [ 777.449041] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_rules [ 777.449193] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_members [ 777.449304] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 942be907-3c05-4417-ab20-76489bce3042 with Priority: HIGHEST for action port [ 777.449653] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8579ac1e-c68a-42fa-957e-e205942d2fbc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.452478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.452478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.452478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.452478] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.452478] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8579ac1e-c68a-42fa-957e-e205942d2fbc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.452478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.452478] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-942be907-3c05-4417-ab20-76489bce3042 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.452478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-942be907-3c05-4417-ab20-76489bce3042" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.452478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-942be907-3c05-4417-ab20-76489bce3042" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.452478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-942be907-3c05-4417-ab20-76489bce3042" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.452478] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('942be907-3c05-4417-ab20-76489bce3042',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.743246] env[69499]: INFO networking_nsxv3.common.synchronization [req-4928448e-ede6-483a-90ea-1c386d0662fc req-e2d4b53f-8ffb-4aef-8ca2-2d7b18ebf684 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGHEST for action security_group_members [ 777.743246] env[69499]: INFO networking_nsxv3.common.synchronization [req-4928448e-ede6-483a-90ea-1c386d0662fc req-e2d4b53f-8ffb-4aef-8ca2-2d7b18ebf684 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: bfb7458a-4a70-45c1-acb5-648c53b6821a with Priority: HIGHEST for action security_group_members [ 777.743246] env[69499]: INFO networking_nsxv3.common.synchronization [req-4928448e-ede6-483a-90ea-1c386d0662fc req-e2d4b53f-8ffb-4aef-8ca2-2d7b18ebf684 tempest-SecurityGroupsTestJSON-1155020626 tempest-SecurityGroupsTestJSON-1155020626-project-member] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 777.743578] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGHEST for action security_group_members [ 777.743743] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfb7458a-4a70-45c1-acb5-648c53b6821a with Priority: HIGHEST for action security_group_members [ 777.743850] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGHEST for action security_group_members [ 777.744135] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.744639] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.744639] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.744639] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.744931] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.744931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.744931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.745060] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.745093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.745836] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.750180] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfb7458a-4a70-45c1-acb5-648c53b6821a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.750180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.750180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.750180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.750180] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.750180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.750180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.750180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.750180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.750180] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfb7458a-4a70-45c1-acb5-648c53b6821a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.750180] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.750180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.750180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.750180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.750180] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.750180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.750180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.750180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.750832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.750832] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.857448] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: SUCCESS [ 777.857828] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.858118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.858492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.858772] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.858935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.859054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.859251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.859356] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.859477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.859598] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.955383] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8579ac1e-c68a-42fa-957e-e205942d2fbc taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.955620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.955697] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 942be907-3c05-4417-ab20-76489bce3042 with status ACTIVE [ 777.955860] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.955968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.956048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.956275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.956362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.956542] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.956641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.956742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.957031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.957031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.957280] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.957280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.957280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.957447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.957447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.957517] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 942be907-3c05-4417-ab20-76489bce3042 is going to be updated. [ 777.981317] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.981412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.981412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.981623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.981778] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.981948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-942be907-3c05-4417-ab20-76489bce3042" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.022089] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: SUCCESS [ 778.022324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.022482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.022710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.022911] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.023036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.023094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.023251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.023333] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.023417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.023616] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.023771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.023771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.023901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.024055] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.024192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.024192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.024342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.024409] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.024503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.024595] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.233953] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc in Status: SUCCESS [ 778.234238] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc deletion is rescheduled due to dependency. [ 778.234323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.234551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.234810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.235314] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.235314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.235314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.235461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.235461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.235535] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.251524] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.251693] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.251767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.252057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.253277] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.253396] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.253630] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.253717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.272433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.278215] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.278215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.278215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.278215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.278215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.278215] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 is going to be updated. [ 778.278215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.278215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.298785] env[69499]: INFO networking_nsxv3.common.synchronization [req-e53b14b6-88f5-413d-805b-d4124a370678 req-7d88d353-db41-4643-adf5-b66fa0f5bfd7 tempest-MultipleCreateTestJSON-19272315 tempest-MultipleCreateTestJSON-19272315-project-member] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 778.299388] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 778.299697] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.299848] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.299905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.300742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.300919] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.301044] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.301139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.301538] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.301632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.301731] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.308711] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.308857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.308921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.309133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.309275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.310943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.313495] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.313495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.313495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.313495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.313495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.313495] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfb7458a-4a70-45c1-acb5-648c53b6821a is going to be updated. [ 778.313495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.313851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.313851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.313851] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.313987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.313987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.315193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.315193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.315193] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be updated. [ 778.318439] env[69499]: INFO networking_nsxv3.common.synchronization [req-18df10ba-a291-4b73-a3a2-873058f1a820 req-4e02daf7-8f01-4c84-9526-235b75c1da85 tempest-MultipleCreateTestJSON-19272315 tempest-MultipleCreateTestJSON-19272315-project-member] Enqueued Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 778.320156] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae with Priority: HIGHEST for action security_group_members [ 778.320156] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.320278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.329325] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 in Status: IN_PROGRESS for 2s [ 778.346177] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.346177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.346177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.346177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.346177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.356709] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.356867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.356954] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.357243] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.357402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.362199] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfb7458a-4a70-45c1-acb5-648c53b6821a in Status: IN_PROGRESS for 2s [ 778.363053] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.363238] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.363308] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.363551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.363736] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.363839] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.363911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.364108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.364191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.364288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.364437] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.364535] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.364588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.365023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.365023] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.365023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.365260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.365260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.365359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.365409] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.366036] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.368115] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: IN_PROGRESS for 2s [ 778.400263] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: SUCCESS [ 778.400485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.400666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.400895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.400985] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.527766] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3283bfac-7979-4949-ab5e-93112edbbd0b: rpc.has_security_group_logging(os_id): False [ 778.549019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.549019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.549019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.549019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.549019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.549019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.549019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.549019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.549019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.549019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.549019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.549019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.549019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.549019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.549019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.549672] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.549672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.549672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.549672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.549672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.549672] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3283bfac-7979-4949-ab5e-93112edbbd0b is going to be updated. [ 778.606022] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.606022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.606022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.606022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.606022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.628205] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: IN_PROGRESS for 2s [ 778.739812] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.805062] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.805062] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.805062] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.805340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.805340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.805528] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.805642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.805705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.805945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.806009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.806059] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be updated. [ 778.835032] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.835229] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.835292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.835502] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.835632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.845535] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: IN_PROGRESS for 2s [ 778.869292] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94d2e4ea-db97-4a0c-91d6-635a39a38e5c: rpc.has_security_group_logging(os_id): False [ 778.886963] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.886963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.886963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.887395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.913050] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.913360] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.913476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.913548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.913742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.913826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.914020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.914143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.914215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.914368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.914444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.914632] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.914763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.914823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.914969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.915050] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.915137] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c is going to be updated. [ 778.928482] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.928657] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.928735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.928984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.929093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.929189] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be deleted. [ 778.985942] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.986132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.986191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.986400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.986543] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.988321] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.988321] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.988491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.988674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.988674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.988833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.001187] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: IN_PROGRESS for 2s [ 779.142412] env[69499]: INFO networking_nsxv3.common.synchronization [req-0e72de13-c52a-4603-b401-9494a855614d req-12196549-012a-415c-9927-d8ec6828ea68 tempest-ServersAdminNegativeTestJSON-242497510 tempest-ServersAdminNegativeTestJSON-242497510-project-member] Enqueued Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_members [ 779.143363] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_members [ 779.143363] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.143363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.143646] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.143646] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.143781] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.143879] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.143936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.144103] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.144184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.144273] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.242258] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.551635] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.551992] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.551992] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.552624] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.552624] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.552815] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.552990] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.553553] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.553553] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.553750] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.553838] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.553956] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.554078] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.554258] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.554432] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.554669] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.573888] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.574161] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 779.574394] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.574648] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.575223] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-1146016d-132b-46f5-9c8e-4352540f16f1 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.575439] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-1146016d-132b-46f5-9c8e-4352540f16f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.575899] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-1146016d-132b-46f5-9c8e-4352540f16f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.576424] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-1146016d-132b-46f5-9c8e-4352540f16f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.576678] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1146016d-132b-46f5-9c8e-4352540f16f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.646468] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.744117] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.744352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.744434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.744645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.744736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.744837] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc is going to be updated. [ 779.772052] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.772204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.772269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.772477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.772632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.780531] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc in Status: IN_PROGRESS for 2s [ 780.079859] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.080218] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.080433] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.080920] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.081105] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.081280] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 1146016d-132b-46f5-9c8e-4352540f16f1 not found, creating... [ 780.082063] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.082063] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.082063] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.082290] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.082475] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.083011] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.083561] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.083561] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.083845] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.083970] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.084180] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 1146016d-132b-46f5-9c8e-4352540f16f1 is going to be created. [ 780.103634] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.104680] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.104680] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.104680] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.104680] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.105176] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-1146016d-132b-46f5-9c8e-4352540f16f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.149463] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.338658] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 in Status: SUCCESS [ 780.338862] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 deletion is rescheduled due to dependency. [ 780.338989] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.371978] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfb7458a-4a70-45c1-acb5-648c53b6821a in Status: SUCCESS [ 780.372172] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfb7458a-4a70-45c1-acb5-648c53b6821a deletion is rescheduled due to dependency. [ 780.372286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfb7458a-4a70-45c1-acb5-648c53b6821a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.377279] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 in Status: SUCCESS [ 780.377437] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 deletion is rescheduled due to dependency. [ 780.377542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.641335] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: SUCCESS [ 780.641682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.641788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.642027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.642117] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.651910] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.652082] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.652155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.652364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.652450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.652548] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f00aea48-dae0-47aa-a96c-f017c0721f54 is going to be updated. [ 780.677397] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.677576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.677626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.677842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.677986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.694486] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: IN_PROGRESS for 2s [ 780.855599] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae in Status: SUCCESS [ 780.855852] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae deletion is rescheduled due to dependency. [ 780.855913] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.856087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.856291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.856463] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.856948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.856948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.856948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.856948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.856948] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.944391] env[69499]: INFO networking_nsxv3.common.synchronization [req-0e72de13-c52a-4603-b401-9494a855614d req-6e005343-7350-4b06-a9af-3bab2586385e service nova] Enqueued Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_rules [ 780.944665] env[69499]: INFO networking_nsxv3.common.synchronization [req-0e72de13-c52a-4603-b401-9494a855614d req-6e005343-7350-4b06-a9af-3bab2586385e service nova] Enqueued Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_members [ 780.944845] env[69499]: INFO networking_nsxv3.common.synchronization [req-0e72de13-c52a-4603-b401-9494a855614d req-6e005343-7350-4b06-a9af-3bab2586385e service nova] Enqueued Resource ID: 1146016d-132b-46f5-9c8e-4352540f16f1 with Priority: HIGHEST for action port [ 780.945379] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_rules [ 780.945549] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_members [ 780.945625] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1146016d-132b-46f5-9c8e-4352540f16f1 with Priority: HIGHEST for action port [ 780.945886] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.946889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.946991] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.947204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.947285] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.948203] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.948350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.948502] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-1146016d-132b-46f5-9c8e-4352540f16f1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.948604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1146016d-132b-46f5-9c8e-4352540f16f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.948662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1146016d-132b-46f5-9c8e-4352540f16f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.948846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1146016d-132b-46f5-9c8e-4352540f16f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.948916] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1146016d-132b-46f5-9c8e-4352540f16f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.015384] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: SUCCESS [ 781.015384] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.144080] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.144297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.144394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.144640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.144866] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.145013] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.145247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.145446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.145571] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.145667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.145762] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.359707] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.359949] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.360180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.360410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.360560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.360862] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.361011] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.361112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.361345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.361481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.361606] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae is going to be deleted. [ 781.389041] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.389041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.389041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.389041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.389041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.389334] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c3c687e-7cfa-4bb8-8ae8-41c1d5d57cae" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.454198] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1146016d-132b-46f5-9c8e-4352540f16f1 with status ACTIVE [ 781.454441] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.454582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.454654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.454906] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.455020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.455208] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.455312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.455375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.455533] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.455613] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.455832] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.455975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.456080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.456173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.456233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.456315] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1146016d-132b-46f5-9c8e-4352540f16f1 is going to be updated. [ 781.457486] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.457582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.476783] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.476926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.477007] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.477227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.477359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.477525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1146016d-132b-46f5-9c8e-4352540f16f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.653020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.653020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.653020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.653020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.653020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.653020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.653020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.653020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.653020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.653020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.653020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.653020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.653020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.653020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.653020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.653020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.653980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.653980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.653980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.653980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.653980] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.790111] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc in Status: SUCCESS [ 781.790111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.790111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.790262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.792364] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.792364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.792364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.792364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.792364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.792364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.792364] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.965178] env[69499]: INFO networking_nsxv3.common.synchronization [req-aac926fa-745c-4bf2-b1d3-03f2f47dff6b req-f1439581-1874-4986-a684-b50c30feaed8 tempest-ServerDiskConfigTestJSON-146039362 tempest-ServerDiskConfigTestJSON-146039362-project-member] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 781.966424] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 781.966813] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.967027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.967145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.967504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.967807] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.968083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.968246] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.968447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.968725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.968725] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.155460] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3283bfac-7979-4949-ab5e-93112edbbd0b: rpc.has_security_group_logging(os_id): False [ 782.177028] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.177028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.177028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.177028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.177028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.177028] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.177028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.177028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.177028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.177028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.177028] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.177028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.177028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.177028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.177028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.178319] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.178687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.178995] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.181106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.181106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.181106] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3283bfac-7979-4949-ab5e-93112edbbd0b is going to be updated. [ 782.251083] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.251083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.251277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.251315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.252395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.266231] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: IN_PROGRESS for 2s [ 782.296719] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.442814] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.443062] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.443191] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.443529] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.443804] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.443963] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.444096] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.444559] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.444559] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.444715] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.444771] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.444884] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.445028] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.445149] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.445256] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.445387] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.464044] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.464229] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 782.464648] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.465013] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.465377] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-bf5812d8-ff5b-4903-82fe-6ea3bbeae10d taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.465557] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-bf5812d8-ff5b-4903-82fe-6ea3bbeae10d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.465703] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-bf5812d8-ff5b-4903-82fe-6ea3bbeae10d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.466071] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-bf5812d8-ff5b-4903-82fe-6ea3bbeae10d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.466225] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5812d8-ff5b-4903-82fe-6ea3bbeae10d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.470993] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.471130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.471201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.471390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.471476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.471662] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.471760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.471825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.471972] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.473313] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.473396] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 already deleted. [ 782.473504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.704311] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: SUCCESS [ 782.704622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.704622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.704733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.704889] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.705012] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.705083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.705459] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.705584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.705704] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.801514] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8579ac1e-c68a-42fa-957e-e205942d2fbc: rpc.has_security_group_logging(os_id): False [ 782.820806] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.820806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.820806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.821098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.821098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.821235] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.821340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.821403] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.821561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.821635] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.821720] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc is going to be updated. [ 782.891915] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.892110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.892287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.892400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.892546] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.905593] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc in Status: IN_PROGRESS for 2s [ 782.969294] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.969589] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.969758] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.970189] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.970374] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.970706] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port bf5812d8-ff5b-4903-82fe-6ea3bbeae10d not found, creating... [ 782.970902] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.971119] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.971870] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.972238] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.972308] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.972610] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.972778] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.972934] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.973205] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.973376] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.973555] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: bf5812d8-ff5b-4903-82fe-6ea3bbeae10d is going to be created. [ 783.008759] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.009078] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.009640] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.009640] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.009845] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.010259] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-bf5812d8-ff5b-4903-82fe-6ea3bbeae10d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.208200] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.711556] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.217261] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.217423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.217498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.217724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.217889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.218055] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f00aea48-dae0-47aa-a96c-f017c0721f54 is going to be updated. [ 784.225927] env[69499]: INFO networking_nsxv3.common.synchronization [req-aac926fa-745c-4bf2-b1d3-03f2f47dff6b req-e0f6b3ff-2169-4661-aeb2-65f8fdf17eb7 service nova] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_rules [ 784.226933] env[69499]: INFO networking_nsxv3.common.synchronization [req-aac926fa-745c-4bf2-b1d3-03f2f47dff6b req-e0f6b3ff-2169-4661-aeb2-65f8fdf17eb7 service nova] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 784.226933] env[69499]: INFO networking_nsxv3.common.synchronization [req-aac926fa-745c-4bf2-b1d3-03f2f47dff6b req-e0f6b3ff-2169-4661-aeb2-65f8fdf17eb7 service nova] Enqueued Resource ID: bf5812d8-ff5b-4903-82fe-6ea3bbeae10d with Priority: HIGHEST for action port [ 784.227847] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_rules [ 784.227847] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 784.227847] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5812d8-ff5b-4903-82fe-6ea3bbeae10d with Priority: HIGHEST for action port [ 784.229096] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.229096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.229096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.229096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.229096] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.230332] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.230332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.230332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.230332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.230332] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.230332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.230680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.230680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.230680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.230680] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.231900] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf5812d8-ff5b-4903-82fe-6ea3bbeae10d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.231900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf5812d8-ff5b-4903-82fe-6ea3bbeae10d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.231900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf5812d8-ff5b-4903-82fe-6ea3bbeae10d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.231900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf5812d8-ff5b-4903-82fe-6ea3bbeae10d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.231900] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5812d8-ff5b-4903-82fe-6ea3bbeae10d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.244888] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.245042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.245111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.246106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.246106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.254311] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: IN_PROGRESS for 2s [ 784.278309] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: SUCCESS [ 784.278527] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.735671] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.735671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.736146] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.737362] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf5812d8-ff5b-4903-82fe-6ea3bbeae10d with status ACTIVE [ 784.737540] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.737697] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.737793] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.738090] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.738288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.738551] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.738686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.738782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.739018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.739144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.739468] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.739601] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.739688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.739883] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.739993] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.740122] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf5812d8-ff5b-4903-82fe-6ea3bbeae10d is going to be updated. [ 784.761926] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.762121] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.762185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.762401] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.762537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.762698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf5812d8-ff5b-4903-82fe-6ea3bbeae10d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.921205] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc in Status: SUCCESS [ 784.921503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.245584] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.749494] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.749494] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.749494] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.749494] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.749959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.749959] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be created. [ 785.771045] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.771288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.771288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.771433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.771584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.780542] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: UNINITIALIZED for 2s [ 786.264182] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: SUCCESS [ 786.264530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.264773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.265070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.265322] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.265491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.265611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.266009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.266009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.266009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.266233] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.769179] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.769179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.769179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.769568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.769568] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.769568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.769683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.770685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.770685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.770685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.770685] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.770685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.770685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.770685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.770685] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.770685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.770685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.771211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.771211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.771211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.771211] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.274183] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f00aea48-dae0-47aa-a96c-f017c0721f54: rpc.has_security_group_logging(os_id): False [ 787.292901] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.293092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.293143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.293351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.310162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.310411] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.310525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.310594] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.310797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.310874] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.315161] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.315161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.315161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.315161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.315161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.315161] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.315161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.315161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.315537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.315537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.315537] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f00aea48-dae0-47aa-a96c-f017c0721f54 is going to be updated. [ 787.376507] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.376694] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.376794] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.377077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.377348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.392182] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: IN_PROGRESS for 2s [ 787.790403] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 787.790702] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.790784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.790994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.791193] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.791311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.791377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.791534] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.791614] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.791697] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.791788] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.294877] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.298526] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.298526] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.298526] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.298526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.299451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.299451] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.803568] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31a7bec7-75f3-4780-ac90-0f2f7e7744e9: rpc.has_security_group_logging(os_id): False [ 788.820162] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.820329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.820534] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.820620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.820703] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.821064] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.821238] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.821238] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.821392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.821477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.821672] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.821769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.821828] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.822008] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.825972] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.826228] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.826338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.826405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.826567] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.826698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.826834] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be created. [ 788.880814] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.880814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.880814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.880814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.881010] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.892877] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 789.010523] env[69499]: INFO networking_nsxv3.common.synchronization [req-367c3bff-c0ea-43e9-b0ad-9c1b819e9228 req-9f9d4cac-35d1-46e0-8006-d43af96b6566 tempest-FloatingIPsAssociationTestJSON-1168940114 tempest-FloatingIPsAssociationTestJSON-1168940114-project-member] Enqueued Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_members [ 789.011233] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 with Priority: HIGHEST for action security_group_members [ 789.011376] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-04847a44-8459-4dcc-b6cd-80a364fba3d0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.011500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.011567] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.011763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.011919] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.014925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.015058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.015281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.015411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.015525] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04847a44-8459-4dcc-b6cd-80a364fba3d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.406343] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: SUCCESS [ 789.406343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.519792] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.519792] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.519792] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.519792] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.537717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.538304] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.538627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.538854] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.539218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.539441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.539670] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 is going to be updated. [ 789.564655] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.564932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.565068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.565714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.565714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.573054] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: IN_PROGRESS for 2s [ 790.904847] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 790.904847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.185776] env[69499]: INFO networking_nsxv3.common.synchronization [req-3e5458f2-d5f5-4fa5-b15a-3822f7dc1253 req-0ca172db-13a3-4113-a45c-aa0808eebcda tempest-ImagesTestJSON-490670806 tempest-ImagesTestJSON-490670806-project-member] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 791.186378] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 791.186689] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.186826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.186897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.187121] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.187277] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.187383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.187448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.187602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.187685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.187782] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.581996] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.582228] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.582370] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.582641] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.582981] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.583243] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.583393] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.584737] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.584737] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.584737] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.584737] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.584737] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.584737] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.584737] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.584737] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.585225] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.586581] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 in Status: SUCCESS [ 791.586779] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04847a44-8459-4dcc-b6cd-80a364fba3d0 deletion is rescheduled due to dependency. [ 791.586884] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04847a44-8459-4dcc-b6cd-80a364fba3d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.602376] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.602741] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 791.603036] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.603904] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.603904] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-8eab7a6c-76ed-4110-b125-8a4202552cc7 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.603904] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-8eab7a6c-76ed-4110-b125-8a4202552cc7" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.604159] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-8eab7a6c-76ed-4110-b125-8a4202552cc7" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.605458] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-8eab7a6c-76ed-4110-b125-8a4202552cc7" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.605458] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eab7a6c-76ed-4110-b125-8a4202552cc7',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.692472] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.692472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.692472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.692472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.711651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.713014] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.713014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.713014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.713014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.713014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.713014] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 791.736118] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.736118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.736118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.736118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.736118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.743159] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 792.108909] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.109264] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.109390] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.109687] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.109750] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.110373] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 8eab7a6c-76ed-4110-b125-8a4202552cc7 not found, creating... [ 792.110373] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.110752] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.110752] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.110752] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.110885] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.111181] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.111340] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.115318] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.115524] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.115883] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.115883] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 8eab7a6c-76ed-4110-b125-8a4202552cc7 is going to be created. [ 792.137329] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.137329] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.137329] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.137329] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.137329] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.137575] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-8eab7a6c-76ed-4110-b125-8a4202552cc7" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.962240] env[69499]: INFO networking_nsxv3.common.synchronization [req-3e5458f2-d5f5-4fa5-b15a-3822f7dc1253 req-e4ad65a5-8c33-4a0a-b0a9-65ae905b085b service nova] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_rules [ 792.962240] env[69499]: INFO networking_nsxv3.common.synchronization [req-3e5458f2-d5f5-4fa5-b15a-3822f7dc1253 req-e4ad65a5-8c33-4a0a-b0a9-65ae905b085b service nova] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 792.962240] env[69499]: INFO networking_nsxv3.common.synchronization [req-3e5458f2-d5f5-4fa5-b15a-3822f7dc1253 req-e4ad65a5-8c33-4a0a-b0a9-65ae905b085b service nova] Enqueued Resource ID: 8eab7a6c-76ed-4110-b125-8a4202552cc7 with Priority: HIGHEST for action port [ 792.962240] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_rules [ 792.962240] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 792.962240] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eab7a6c-76ed-4110-b125-8a4202552cc7 with Priority: HIGHEST for action port [ 792.962240] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.962240] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.962240] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.963964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.964379] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.965572] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.970080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.970080] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-8eab7a6c-76ed-4110-b125-8a4202552cc7 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.970080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8eab7a6c-76ed-4110-b125-8a4202552cc7" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.970080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8eab7a6c-76ed-4110-b125-8a4202552cc7" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.970080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8eab7a6c-76ed-4110-b125-8a4202552cc7" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.970080] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eab7a6c-76ed-4110-b125-8a4202552cc7',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.471928] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.472224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.476282] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8eab7a6c-76ed-4110-b125-8a4202552cc7 with status ACTIVE [ 793.476520] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.476663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.476725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.476937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.477038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.477437] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.477437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.477437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.477575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.477610] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.477799] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.478863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.478863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.478863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.478863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.478863] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8eab7a6c-76ed-4110-b125-8a4202552cc7 is going to be updated. [ 793.500200] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.500200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.500200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.500200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.500200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.500200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8eab7a6c-76ed-4110-b125-8a4202552cc7" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.755642] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 793.755845] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de deletion is rescheduled due to dependency. [ 793.756343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.756457] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.756713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.756901] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.757038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.757110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.757341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.757493] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.757601] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.942100] env[69499]: INFO networking_nsxv3.common.synchronization [None req-61b27a5e-1a15-4b25-91dd-0b07d01c790c None None] Enqueued Resource ID: dc8c54dc-8a6d-4d7d-8d84-aef5d10e5a64 with Priority: HIGHEST for action port [ 793.942367] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c54dc-8a6d-4d7d-8d84-aef5d10e5a64 with Priority: HIGHEST for action port [ 793.942943] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc8c54dc-8a6d-4d7d-8d84-aef5d10e5a64 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.943068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc8c54dc-8a6d-4d7d-8d84-aef5d10e5a64" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.943143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc8c54dc-8a6d-4d7d-8d84-aef5d10e5a64" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.943399] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc8c54dc-8a6d-4d7d-8d84-aef5d10e5a64" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.943482] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc8c54dc-8a6d-4d7d-8d84-aef5d10e5a64',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.134408] env[69499]: INFO networking_nsxv3.common.synchronization [req-71221ccf-8d25-49fe-b7ce-273fde0ecc46 req-531fe2c6-3b81-48ca-b423-5c54b65e25e4 tempest-ServersAdminNegativeTestJSON-242497510 tempest-ServersAdminNegativeTestJSON-242497510-project-member] Enqueued Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_members [ 794.134908] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_members [ 794.135030] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.135115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.135197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.135376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.135527] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.135622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.135681] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.135827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.135911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.136017] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.262042] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.446152] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc8c54dc-8a6d-4d7d-8d84-aef5d10e5a64 [ 794.446286] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.446434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.446491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.446779] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.446837] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.446962] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc8c54dc-8a6d-4d7d-8d84-aef5d10e5a64 already deleted. [ 794.447078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc8c54dc-8a6d-4d7d-8d84-aef5d10e5a64" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.638469] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.764484] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.142947] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.266677] env[69499]: INFO networking_nsxv3.common.synchronization [None req-acb495e6-ee50-41d6-a41a-a9705d9b6fa0 tempest-ServersV294TestFqdnHostnames-1817828186 tempest-ServersV294TestFqdnHostnames-1817828186-project-member] Enqueued Resource ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d with Priority: HIGHEST for action security_group_rules [ 795.266677] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d with Priority: HIGHEST for action security_group_rules [ 795.266808] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.266936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.267045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.267259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.267352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.267447] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 795.268796] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.269046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.269046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.269272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.269360] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68bf910a-7d9f-4466-9028-7ab38c7fc30d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.296515] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.296747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.296747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.296951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.297131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.305760] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 795.356384] env[69499]: INFO networking_nsxv3.common.synchronization [None req-1992e45a-a413-4259-b577-be8e7b57351a tempest-ServersV294TestFqdnHostnames-1817828186 tempest-ServersV294TestFqdnHostnames-1817828186-project-member] Enqueued Resource ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d with Priority: HIGHEST for action security_group_rules [ 795.357422] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d with Priority: HIGHEST for action security_group_rules [ 795.357676] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.357676] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.644744] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.645257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.645257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.645257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.645651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.645785] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f00aea48-dae0-47aa-a96c-f017c0721f54 is going to be updated. [ 795.677468] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.677589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.677589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.677762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.677935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.688469] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: IN_PROGRESS for 2s [ 795.791134] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.791134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.791134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.791134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.791134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.791134] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d already deleted. [ 795.791134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.791134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.791134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.791134] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68bf910a-7d9f-4466-9028-7ab38c7fc30d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.869049] env[69499]: INFO networking_nsxv3.common.synchronization [req-4284bfd3-3f06-40a6-a82d-7052af7d875b req-4671e261-b631-4447-b675-9c0e92b4d846 tempest-ServerMetadataNegativeTestJSON-1074733564 tempest-ServerMetadataNegativeTestJSON-1074733564-project-member] Enqueued Resource ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 with Priority: HIGHEST for action security_group_members [ 795.869573] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 with Priority: HIGHEST for action security_group_members [ 795.869883] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a81501c-f74a-48d9-97d5-db6c60895c60 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.871157] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.871157] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.871296] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.871416] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.871545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.871631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.871827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.871912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.872034] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a81501c-f74a-48d9-97d5-db6c60895c60',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.996959] env[69499]: INFO networking_nsxv3.common.synchronization [None req-c6b894c4-330b-43f3-b2c4-5a2368e2886d None None] Enqueued Resource ID: 00afe2fc-7994-4d57-b284-85cd456381af with Priority: HIGHEST for action port [ 795.997232] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00afe2fc-7994-4d57-b284-85cd456381af with Priority: HIGHEST for action port [ 795.997798] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-00afe2fc-7994-4d57-b284-85cd456381af taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.998029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00afe2fc-7994-4d57-b284-85cd456381af" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.998120] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00afe2fc-7994-4d57-b284-85cd456381af" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.998399] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00afe2fc-7994-4d57-b284-85cd456381af" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.998476] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00afe2fc-7994-4d57-b284-85cd456381af',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.310483] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.310483] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.310483] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.310674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.310674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.310743] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d already deleted. [ 796.311432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.377288] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.377434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.377500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.377728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.377795] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.378012] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.378130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.378170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.378979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.379174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.379580] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 already deleted. [ 796.379764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.380843] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-683 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.381201] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-683" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.381343] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-683" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.381678] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-683" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.382158] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.382393] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.382575] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.382731] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.382868] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.383118] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.383254] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.383368] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.383474] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.383600] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.383706] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.383836] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.400658] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.401530] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 796.401530] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.401530] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-683" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.401530] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-3847267d-8046-4477-bcdf-bc5c63c945fa taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.401814] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-3847267d-8046-4477-bcdf-bc5c63c945fa" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.401906] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-3847267d-8046-4477-bcdf-bc5c63c945fa" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.402158] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-3847267d-8046-4477-bcdf-bc5c63c945fa" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.402304] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3847267d-8046-4477-bcdf-bc5c63c945fa',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.501012] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00afe2fc-7994-4d57-b284-85cd456381af [ 796.501298] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.501436] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.501521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.501743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.501832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.501930] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00afe2fc-7994-4d57-b284-85cd456381af already deleted. [ 796.502036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00afe2fc-7994-4d57-b284-85cd456381af" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.905494] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.905974] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.905974] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.906310] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.906529] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.906742] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 3847267d-8046-4477-bcdf-bc5c63c945fa not found, creating... [ 796.907105] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.907750] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.907750] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.907750] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.907943] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.908549] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.908549] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.908905] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.909071] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.909140] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.909336] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 3847267d-8046-4477-bcdf-bc5c63c945fa is going to be created. [ 796.929554] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.929774] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.929897] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.930214] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.930441] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.930676] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-3847267d-8046-4477-bcdf-bc5c63c945fa" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.316474] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 797.316727] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.316900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.317231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.317419] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.317536] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.317602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.317755] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.317835] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.318133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.318265] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.686994] env[69499]: INFO networking_nsxv3.common.synchronization [req-4284bfd3-3f06-40a6-a82d-7052af7d875b req-fcb37035-2591-479b-8fa2-9b785fc3c3ff service nova] Enqueued Resource ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 with Priority: HIGHEST for action security_group_rules [ 797.687411] env[69499]: INFO networking_nsxv3.common.synchronization [req-4284bfd3-3f06-40a6-a82d-7052af7d875b req-fcb37035-2591-479b-8fa2-9b785fc3c3ff service nova] Enqueued Resource ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 with Priority: HIGHEST for action security_group_members [ 797.688573] env[69499]: INFO networking_nsxv3.common.synchronization [req-4284bfd3-3f06-40a6-a82d-7052af7d875b req-fcb37035-2591-479b-8fa2-9b785fc3c3ff service nova] Enqueued Resource ID: 3847267d-8046-4477-bcdf-bc5c63c945fa with Priority: HIGHEST for action port [ 797.689663] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 with Priority: HIGHEST for action security_group_rules [ 797.692185] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 with Priority: HIGHEST for action security_group_members [ 797.692185] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3847267d-8046-4477-bcdf-bc5c63c945fa with Priority: HIGHEST for action port [ 797.692185] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a81501c-f74a-48d9-97d5-db6c60895c60 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.692185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.692185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.692185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.692185] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a81501c-f74a-48d9-97d5-db6c60895c60',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.692646] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a81501c-f74a-48d9-97d5-db6c60895c60 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.692777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.692861] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.693189] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.693392] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.693523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.693607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.693787] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.693900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.693993] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a81501c-f74a-48d9-97d5-db6c60895c60',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.695103] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-3847267d-8046-4477-bcdf-bc5c63c945fa taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.697031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3847267d-8046-4477-bcdf-bc5c63c945fa" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.697031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3847267d-8046-4477-bcdf-bc5c63c945fa" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.697031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3847267d-8046-4477-bcdf-bc5c63c945fa" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.697031] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3847267d-8046-4477-bcdf-bc5c63c945fa',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.704939] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: SUCCESS [ 797.705154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.820849] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.821044] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.821097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.821308] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.821477] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.821592] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.821685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.821825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.821893] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.821983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.822147] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.822239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.822299] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.822443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.822582] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.822703] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.823204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.823204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.823204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.823204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.823204] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.200435] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a81501c-f74a-48d9-97d5-db6c60895c60',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.203489] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a81501c-f74a-48d9-97d5-db6c60895c60 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.203489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.203489] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3847267d-8046-4477-bcdf-bc5c63c945fa with status ACTIVE [ 798.203489] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.203489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.203489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.203489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.203489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.203489] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.203489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.203489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.203489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.203489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.203489] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.204887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.204887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.204887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.204887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.204887] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3847267d-8046-4477-bcdf-bc5c63c945fa is going to be updated. [ 798.226413] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.226413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.226413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.226413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.226413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.226413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3847267d-8046-4477-bcdf-bc5c63c945fa" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.325548] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 137495f6-8f3c-475d-b71c-88971c3781de: rpc.has_security_group_logging(os_id): False [ 798.345810] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.345810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.345810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.345810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.346151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.346389] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.346389] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.346600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.346600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.346700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.346818] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.346904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.346961] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.347134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.347202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.347391] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.347486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.347545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.347673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.347741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.347821] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 798.404898] env[69499]: INFO networking_nsxv3.common.synchronization [req-4df4a8a4-4973-4b2b-998e-d68b15e0893b req-93ae11a0-8335-48aa-b6b6-3e3e7108b38f tempest-ServerActionsV293TestJSON-1166940701 tempest-ServerActionsV293TestJSON-1166940701-project-member] Enqueued Resource ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f with Priority: HIGHEST for action security_group_members [ 798.405468] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f with Priority: HIGHEST for action security_group_members [ 798.405789] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-44133d71-0f30-4e7f-9c96-2491812bcd1f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.405945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.405945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.406609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.406609] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.406758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.406794] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.407491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.407491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.407491] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44133d71-0f30-4e7f-9c96-2491812bcd1f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.420581] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.420756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.420825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.421020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.421172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.442986] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 798.708517] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a81501c-f74a-48d9-97d5-db6c60895c60',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.830617] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-549 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.830869] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-549" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.831051] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-549" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.831431] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-549" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.831755] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.831934] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.832333] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.832617] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.832805] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.833077] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.833231] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.833354] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.833498] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.833620] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.837252] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.837252] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.857416] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.857416] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 798.857416] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.857416] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-549" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.857416] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-1c600feb-bfdc-4b2e-b45b-83ec520ce13a taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.857416] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-1c600feb-bfdc-4b2e-b45b-83ec520ce13a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.857416] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-1c600feb-bfdc-4b2e-b45b-83ec520ce13a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.857416] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-1c600feb-bfdc-4b2e-b45b-83ec520ce13a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.857416] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c600feb-bfdc-4b2e-b45b-83ec520ce13a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.908990] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.909271] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.909349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.909531] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.909657] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.909865] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.910082] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.910082] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.910209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.910373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.910411] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f already deleted. [ 798.910606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.213117] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.213117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.213117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.213117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.213117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.213117] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 is going to be created. [ 799.237738] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.237738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.237738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.237738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.237738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.246828] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 in Status: UNINITIALIZED for 2s [ 799.359865] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.360475] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.360475] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.360776] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.360881] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.361090] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 1c600feb-bfdc-4b2e-b45b-83ec520ce13a not found, creating... [ 799.361375] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.361549] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.361670] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.361886] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.362038] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.362329] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.362483] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.362600] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.362806] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.362937] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.363110] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 1c600feb-bfdc-4b2e-b45b-83ec520ce13a is going to be created. [ 799.381433] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.381669] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.381867] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.382149] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.382369] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.382582] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-1c600feb-bfdc-4b2e-b45b-83ec520ce13a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.213135] env[69499]: INFO networking_nsxv3.common.synchronization [req-4df4a8a4-4973-4b2b-998e-d68b15e0893b req-52a1c2e2-5a7d-4c8c-9277-6389d1593476 service nova] Enqueued Resource ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f with Priority: HIGHEST for action security_group_rules [ 800.213379] env[69499]: INFO networking_nsxv3.common.synchronization [req-4df4a8a4-4973-4b2b-998e-d68b15e0893b req-52a1c2e2-5a7d-4c8c-9277-6389d1593476 service nova] Enqueued Resource ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f with Priority: HIGHEST for action security_group_members [ 800.213535] env[69499]: INFO networking_nsxv3.common.synchronization [req-4df4a8a4-4973-4b2b-998e-d68b15e0893b req-52a1c2e2-5a7d-4c8c-9277-6389d1593476 service nova] Enqueued Resource ID: 1c600feb-bfdc-4b2e-b45b-83ec520ce13a with Priority: HIGHEST for action port [ 800.214399] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f with Priority: HIGHEST for action security_group_rules [ 800.214577] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f with Priority: HIGHEST for action security_group_members [ 800.214806] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c600feb-bfdc-4b2e-b45b-83ec520ce13a with Priority: HIGHEST for action port [ 800.215567] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44133d71-0f30-4e7f-9c96-2491812bcd1f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.215735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.215828] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.216068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.216185] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44133d71-0f30-4e7f-9c96-2491812bcd1f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.217448] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-44133d71-0f30-4e7f-9c96-2491812bcd1f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.217611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.217703] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.217940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.218134] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.218264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.218348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.218771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.218771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.218771] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44133d71-0f30-4e7f-9c96-2491812bcd1f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.221414] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c600feb-bfdc-4b2e-b45b-83ec520ce13a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.221592] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c600feb-bfdc-4b2e-b45b-83ec520ce13a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.221685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c600feb-bfdc-4b2e-b45b-83ec520ce13a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.221877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c600feb-bfdc-4b2e-b45b-83ec520ce13a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.222184] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c600feb-bfdc-4b2e-b45b-83ec520ce13a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.466149] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 800.466270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.724324] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44133d71-0f30-4e7f-9c96-2491812bcd1f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.725415] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-44133d71-0f30-4e7f-9c96-2491812bcd1f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.725557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.733464] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c600feb-bfdc-4b2e-b45b-83ec520ce13a with status ACTIVE [ 800.733626] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.733748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.733814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.734045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.734142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.734324] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.734463] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.734516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.734643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.734720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.734900] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.734992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.735065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.735210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.735287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.735458] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c600feb-bfdc-4b2e-b45b-83ec520ce13a is going to be updated. [ 800.757054] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.757272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.757374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.757644] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.757822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.758096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c600feb-bfdc-4b2e-b45b-83ec520ce13a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.221816] env[69499]: INFO networking_nsxv3.common.synchronization [req-38576bcc-83ad-4b01-a86b-b0317882a6e1 req-314c28b2-df31-45d0-b32a-b29301f49d87 tempest-ServersAdminTestJSON-2112223204 tempest-ServersAdminTestJSON-2112223204-project-member] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 801.222251] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 801.222542] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.222663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.222731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.222932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.223638] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.223767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.224025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.224025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.224110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.224186] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.236807] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44133d71-0f30-4e7f-9c96-2491812bcd1f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.259938] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 in Status: SUCCESS [ 801.260151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.260345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.261232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.261541] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.261674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.261744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.261915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.262298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.262298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.262298] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a81501c-f74a-48d9-97d5-db6c60895c60',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.725168] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-797 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.725273] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.727598] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.727598] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.727598] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.727598] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.727598] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.727598] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.727598] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.727598] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.727598] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.727598] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.727598] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.727598] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.727598] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.729368] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.730301] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.739986] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.739986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.739986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.739986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.739986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.739986] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f is going to be created. [ 801.750027] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.750027] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.750027] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.750027] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.750027] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-4b2d1982-f340-4f92-a2ab-eb47c01e39c8 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.750972] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-4b2d1982-f340-4f92-a2ab-eb47c01e39c8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.751535] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-4b2d1982-f340-4f92-a2ab-eb47c01e39c8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.752156] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-4b2d1982-f340-4f92-a2ab-eb47c01e39c8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.752576] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b2d1982-f340-4f92-a2ab-eb47c01e39c8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.760516] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.760516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.760516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.760516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.760516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.765080] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a81501c-f74a-48d9-97d5-db6c60895c60 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.765230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.765292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.765461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.765622] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.765724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.765781] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.767286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.767286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.767286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.767286] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a81501c-f74a-48d9-97d5-db6c60895c60 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.767286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.767286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.767286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.767286] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.767286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.767286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.767286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.767286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.767286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.767286] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a81501c-f74a-48d9-97d5-db6c60895c60',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.769242] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f in Status: UNINITIALIZED for 2s [ 802.235943] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.257587] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.257951] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.261277] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.261771] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.262035] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.262310] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 4b2d1982-f340-4f92-a2ab-eb47c01e39c8 not found, creating... [ 802.262797] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.263224] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.263471] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.263842] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.264109] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.264635] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.264902] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.265156] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.265428] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.265629] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.265740] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 4b2d1982-f340-4f92-a2ab-eb47c01e39c8 is going to be created. [ 802.270653] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a81501c-f74a-48d9-97d5-db6c60895c60: rpc.has_security_group_logging(os_id): False [ 802.285789] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.285912] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.286047] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.286353] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.286568] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.286783] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-4b2d1982-f340-4f92-a2ab-eb47c01e39c8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.288166] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.288270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.288338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.288499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.288576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.288762] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.288852] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.288914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.289079] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.289154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.289320] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.289423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.289482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.289617] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.289687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.289867] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.289947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.290015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.290150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.290299] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.290299] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 is going to be created. [ 802.373651] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.373747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.373824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.374086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.374276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.385206] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 in Status: IN_PROGRESS for 2s [ 802.737306] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.737465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.737541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.737833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.737980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.738105] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be updated. [ 802.765753] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.766028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.766092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.766324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.766507] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.776232] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 803.080166] env[69499]: INFO networking_nsxv3.common.synchronization [req-38576bcc-83ad-4b01-a86b-b0317882a6e1 req-13a7fa15-5180-415b-9771-b54505e6b6e3 service nova] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_rules [ 803.080360] env[69499]: INFO networking_nsxv3.common.synchronization [req-38576bcc-83ad-4b01-a86b-b0317882a6e1 req-13a7fa15-5180-415b-9771-b54505e6b6e3 service nova] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 803.080544] env[69499]: INFO networking_nsxv3.common.synchronization [req-38576bcc-83ad-4b01-a86b-b0317882a6e1 req-13a7fa15-5180-415b-9771-b54505e6b6e3 service nova] Enqueued Resource ID: 4b2d1982-f340-4f92-a2ab-eb47c01e39c8 with Priority: HIGHEST for action port [ 803.081122] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_rules [ 803.081366] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 803.081442] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b2d1982-f340-4f92-a2ab-eb47c01e39c8 with Priority: HIGHEST for action port [ 803.081742] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.081908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.082107] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.082531] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.082647] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.083534] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.083661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.083895] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b2d1982-f340-4f92-a2ab-eb47c01e39c8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.084014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b2d1982-f340-4f92-a2ab-eb47c01e39c8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.084140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b2d1982-f340-4f92-a2ab-eb47c01e39c8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.084443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b2d1982-f340-4f92-a2ab-eb47c01e39c8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.084544] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b2d1982-f340-4f92-a2ab-eb47c01e39c8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.587169] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.587455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.587502] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b2d1982-f340-4f92-a2ab-eb47c01e39c8 with status ACTIVE [ 803.587660] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.587778] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.587844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.588332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.588447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.588625] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.588726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.588788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.588952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.589067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.589256] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.589413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.589413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.589547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.589622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.589707] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b2d1982-f340-4f92-a2ab-eb47c01e39c8 is going to be updated. [ 803.608982] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.609252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.609352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.609653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.609858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.610118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b2d1982-f340-4f92-a2ab-eb47c01e39c8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.778637] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f in Status: SUCCESS [ 803.778752] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.779173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.779173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.779284] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.779397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.779459] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.779620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.780881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.780881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.780881] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44133d71-0f30-4e7f-9c96-2491812bcd1f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.284732] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44133d71-0f30-4e7f-9c96-2491812bcd1f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.395701] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 in Status: SUCCESS [ 804.395967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.786359] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 804.786359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.786359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.787866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.787866] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.787866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.787866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.787866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.787866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.787866] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.788217] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44133d71-0f30-4e7f-9c96-2491812bcd1f: rpc.has_security_group_logging(os_id): False [ 804.803192] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.803397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.803397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.803602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.803727] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.804019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.804128] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.804196] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.804424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.804517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.804611] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f is going to be created. [ 804.857565] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.858511] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.858616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.858822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.862080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.872019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f in Status: IN_PROGRESS for 2s [ 805.291991] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.793767] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.298564] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.298765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.298765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.300648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.300648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.300648] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be updated. [ 806.329445] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.329587] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.329650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.329870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.330034] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.342779] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 806.368292] env[69499]: INFO networking_nsxv3.common.synchronization [req-bce3db1b-9701-4be7-9945-4c6ec1bef715 req-395feae6-0a30-44f4-9f83-50e38776116e tempest-ServerDiagnosticsTest-940307894 tempest-ServerDiagnosticsTest-940307894-project-member] Enqueued Resource ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a with Priority: HIGHEST for action security_group_members [ 806.368873] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a with Priority: HIGHEST for action security_group_members [ 806.369238] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.369387] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.369464] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.369789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.369949] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.371510] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.371595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.371783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.371875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.371970] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e373b9-4e6a-452b-b0ab-03e94d0ab90a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.875274] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.875793] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.875793] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.875793] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.875793] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.876133] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.876209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.876266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.876437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.876513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.876676] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a already deleted. [ 806.876676] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.880872] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f in Status: SUCCESS [ 806.881081] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.937241] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.937592] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.937813] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.938541] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.938659] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.938811] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.940301] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.940301] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.940301] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.940301] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.940301] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.940301] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.940301] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.940301] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.940301] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.940708] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.961820] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.961990] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 806.962378] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.962378] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-516" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.962915] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-96c81b64-791f-483d-bbfe-315f7811d01f taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.963943] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-96c81b64-791f-483d-bbfe-315f7811d01f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.963943] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-96c81b64-791f-483d-bbfe-315f7811d01f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.964184] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-96c81b64-791f-483d-bbfe-315f7811d01f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.964184] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96c81b64-791f-483d-bbfe-315f7811d01f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.103127] env[69499]: INFO networking_nsxv3.common.synchronization [req-610e9cc9-1c14-4045-bad0-53a452bba6c2 req-c98be5c6-595c-4b81-bf1d-73ebe50b697b tempest-ListServersNegativeTestJSON-163043732 tempest-ListServersNegativeTestJSON-163043732-project-member] Enqueued Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 807.103834] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 807.104221] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.104350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.104420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.105800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.105800] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.105800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.105800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.106127] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.106225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.106545] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.273414] env[69499]: INFO networking_nsxv3.common.synchronization [req-c1b44b67-d69c-4273-95f9-0c40a7ca54d1 req-f556198f-081a-4a48-8155-11d2c52288a0 tempest-ListServersNegativeTestJSON-163043732 tempest-ListServersNegativeTestJSON-163043732-project-member] Enqueued Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 807.273414] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGHEST for action security_group_members [ 807.273414] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.273414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.466553] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.466796] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.466958] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.467281] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.467470] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.467589] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 96c81b64-791f-483d-bbfe-315f7811d01f not found, creating... [ 807.467946] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.468132] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.468316] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.468495] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.468668] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.469019] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.469978] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.470189] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.470919] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.470919] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.471093] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 96c81b64-791f-483d-bbfe-315f7811d01f is going to be created. [ 807.493213] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.493439] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.493556] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.494403] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.494403] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.494403] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-96c81b64-791f-483d-bbfe-315f7811d01f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.609410] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.991039] env[69499]: INFO networking_nsxv3.common.synchronization [req-7c8e24b3-1d2f-4874-9000-e4a45536c578 req-ff7f49f4-a734-4e3c-a422-5a7320b6ed72 tempest-ServerDiskConfigTestJSON-146039362 tempest-ServerDiskConfigTestJSON-146039362-project-member] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 807.991039] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 807.991622] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.991874] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.992105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.995169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.995169] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.995169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.995169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.995169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.995169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.995169] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.111939] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.347292] env[69499]: INFO networking_nsxv3.common.synchronization [req-bce3db1b-9701-4be7-9945-4c6ec1bef715 req-a9d473e5-1dcf-47f9-8aea-57fe9dcf501c service nova] Enqueued Resource ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a with Priority: HIGHEST for action security_group_rules [ 808.347378] env[69499]: INFO networking_nsxv3.common.synchronization [req-bce3db1b-9701-4be7-9945-4c6ec1bef715 req-a9d473e5-1dcf-47f9-8aea-57fe9dcf501c service nova] Enqueued Resource ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a with Priority: HIGHEST for action security_group_members [ 808.347601] env[69499]: INFO networking_nsxv3.common.synchronization [req-bce3db1b-9701-4be7-9945-4c6ec1bef715 req-a9d473e5-1dcf-47f9-8aea-57fe9dcf501c service nova] Enqueued Resource ID: 96c81b64-791f-483d-bbfe-315f7811d01f with Priority: HIGHEST for action port [ 808.348195] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a with Priority: HIGHEST for action security_group_rules [ 808.348269] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a with Priority: HIGHEST for action security_group_members [ 808.348331] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c81b64-791f-483d-bbfe-315f7811d01f with Priority: HIGHEST for action port [ 808.348605] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.348745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.348803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.349039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.349139] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10e373b9-4e6a-452b-b0ab-03e94d0ab90a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.350250] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.350385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.350447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.350682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.350845] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.350942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.351011] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.351170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.351250] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.351341] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e373b9-4e6a-452b-b0ab-03e94d0ab90a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.354113] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-96c81b64-791f-483d-bbfe-315f7811d01f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.354221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96c81b64-791f-483d-bbfe-315f7811d01f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.354389] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96c81b64-791f-483d-bbfe-315f7811d01f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.354449] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96c81b64-791f-483d-bbfe-315f7811d01f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.354517] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96c81b64-791f-483d-bbfe-315f7811d01f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.358188] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 808.358188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.358188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.358188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.358188] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.358188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.358188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.358188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.358188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.358188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.358188] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.496642] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.496642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.496773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.496943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.497082] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.497322] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.497534] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.497534] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.497669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.497738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.497818] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be updated. [ 808.522592] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.522769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.522836] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.523042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.523194] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.531935] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 808.615144] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.615345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.615448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.616317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.616317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.616317] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3283bfac-7979-4949-ab5e-93112edbbd0b is going to be updated. [ 808.643816] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.643962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.644070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.644287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.644433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.653030] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: IN_PROGRESS for 2s [ 808.854801] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10e373b9-4e6a-452b-b0ab-03e94d0ab90a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.857774] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.857891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.859267] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96c81b64-791f-483d-bbfe-315f7811d01f with status ACTIVE [ 808.859488] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.859618] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.859721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.860151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.860151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.860306] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.860934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.860934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.860934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.860934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.861160] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.861316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.861412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.861591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.861675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.861763] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96c81b64-791f-483d-bbfe-315f7811d01f is going to be updated. [ 808.863558] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.863883] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.863987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.864244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.864416] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.864500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.864622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.864740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.864846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.864884] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.865392] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.865392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.865392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.865392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.865642] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.865642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.865642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.865816] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.865816] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.865885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.865965] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.887465] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.887624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.887672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.887906] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.888110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.888675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96c81b64-791f-483d-bbfe-315f7811d01f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.357439] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10e373b9-4e6a-452b-b0ab-03e94d0ab90a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.368450] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 645b270d-e6d4-4f84-872d-3c097c5f4722: rpc.has_security_group_logging(os_id): False [ 809.384883] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.385313] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.385313] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.385481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.385616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.386075] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.386413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.386413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.386603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.386693] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.386943] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.387097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.387185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.387377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.387481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.387788] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.387907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.387993] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.388211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.388315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.388432] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be updated. [ 809.444130] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.444384] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.444384] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.444658] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.444825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.463510] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 809.862526] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.862707] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.862777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.863037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.863138] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.863564] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a is going to be created. [ 809.885377] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.885556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.885719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.885973] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.886249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.902740] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a in Status: UNINITIALIZED for 2s [ 810.541926] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 810.542319] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 deletion is rescheduled due to dependency. [ 810.542319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.662021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: SUCCESS [ 810.662021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.662197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.662477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.662619] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.662619] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.662751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.662847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.662933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.663041] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.670315] env[69499]: INFO networking_nsxv3.common.synchronization [req-14416a9c-c0c2-49f5-9199-1dfced84770f req-605f2210-f770-4b53-a680-40ad0455ca48 tempest-ServerMetadataNegativeTestJSON-1074733564 tempest-ServerMetadataNegativeTestJSON-1074733564-project-member] Enqueued Resource ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 with Priority: HIGHEST for action security_group_members [ 810.670908] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 with Priority: HIGHEST for action security_group_members [ 810.671143] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a81501c-f74a-48d9-97d5-db6c60895c60 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.671267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.671334] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.671526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.671678] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.671773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.671832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.671977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.672800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.672800] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a81501c-f74a-48d9-97d5-db6c60895c60',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.171229] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.171229] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.171229] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.171229] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.171229] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.171645] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.171645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.171645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.171645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.171800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.171800] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3283bfac-7979-4949-ab5e-93112edbbd0b is going to be updated. [ 811.175971] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.175971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.175971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.175971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.175971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.175971] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.175971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.175971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.175971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.175971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.175971] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 is going to be updated. [ 811.197281] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.197597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.197707] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.198069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.198295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.200216] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.200358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.200427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.200608] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.200732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.215640] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: IN_PROGRESS for 2s [ 811.216471] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 in Status: IN_PROGRESS for 2s [ 811.479097] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 811.479340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.912954] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a in Status: SUCCESS [ 811.913287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.913507] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.913760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.914036] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.914203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.914280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.914513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.914624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.914732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.915942] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10e373b9-4e6a-452b-b0ab-03e94d0ab90a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.418825] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.418995] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.419112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.419433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.419662] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.419772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.419837] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.420016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.420110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.420202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.420361] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.420456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.420517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.420752] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.420949] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.421061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.421219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.421282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.421380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.421415] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.421696] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10e373b9-4e6a-452b-b0ab-03e94d0ab90a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.925763] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10e373b9-4e6a-452b-b0ab-03e94d0ab90a: rpc.has_security_group_logging(os_id): False [ 812.943622] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.943981] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.943981] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.944330] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.944330] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.944330] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.944524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.944524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.944626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.944692] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.944875] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.944970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.945045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.945218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.945327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.945527] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.945628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.945687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.945847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.945937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.949612] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a is going to be created. [ 813.005543] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.005843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.005843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.006170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.006243] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.015813] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a in Status: IN_PROGRESS for 2s [ 813.227374] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 in Status: SUCCESS [ 813.227575] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a81501c-f74a-48d9-97d5-db6c60895c60 deletion is rescheduled due to dependency. [ 813.227659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a81501c-f74a-48d9-97d5-db6c60895c60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.228457] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3283bfac-7979-4949-ab5e-93112edbbd0b in Status: SUCCESS [ 813.228634] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3283bfac-7979-4949-ab5e-93112edbbd0b deletion is rescheduled due to dependency. [ 813.228801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.795849] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.796081] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.796180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.796748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.796748] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.288314] env[69499]: INFO networking_nsxv3.common.synchronization [None req-576676f7-96d8-46c6-9c2a-34860318f43c None None] Enqueued Resource ID: 44a18493-1cee-4278-b166-3f0ad0df53d0 with Priority: HIGHEST for action port [ 814.288314] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44a18493-1cee-4278-b166-3f0ad0df53d0 with Priority: HIGHEST for action port [ 814.288314] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-44a18493-1cee-4278-b166-3f0ad0df53d0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.289948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44a18493-1cee-4278-b166-3f0ad0df53d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.290190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44a18493-1cee-4278-b166-3f0ad0df53d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.291499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44a18493-1cee-4278-b166-3f0ad0df53d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.291734] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44a18493-1cee-4278-b166-3f0ad0df53d0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.304285] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.796426] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44a18493-1cee-4278-b166-3f0ad0df53d0 [ 814.796426] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.796426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.796426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.796426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.796426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.796426] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44a18493-1cee-4278-b166-3f0ad0df53d0 already deleted. [ 814.796426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44a18493-1cee-4278-b166-3f0ad0df53d0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.806178] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.028319] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a in Status: SUCCESS [ 815.028604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.308457] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 815.308811] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 815.679681] env[69499]: INFO networking_nsxv3.common.synchronization [req-9dc43cfa-40cc-41e5-bd98-73ffc749ab4b req-4e2a02af-34e4-40ad-8ef3-b53559d92aed tempest-ImagesOneServerNegativeTestJSON-1949881093 tempest-ImagesOneServerNegativeTestJSON-1949881093-project-member] Enqueued Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 815.679681] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 815.680666] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.680848] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.680955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.681399] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.681623] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.681897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.682015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.682415] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.682896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.683073] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.186969] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.187158] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.187231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.187447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.217393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.217661] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.217780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.217848] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.218166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.218317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.218444] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 is going to be updated. [ 816.237847] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.238043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.238126] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.239894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.253189] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 816.253189] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.255114] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 816.257503] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.257693] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.257801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.258442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.258650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.267362] env[69499]: INFO networking_nsxv3.common.synchronization [None req-6b01a5c4-7019-45d6-86eb-c8cf05a49dd6 None None] Enqueued Resource ID: 1529a995-b4f5-49cd-8e51-c3d73755ec35 with Priority: HIGHEST for action port [ 816.267613] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1529a995-b4f5-49cd-8e51-c3d73755ec35 with Priority: HIGHEST for action port [ 816.268220] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-1529a995-b4f5-49cd-8e51-c3d73755ec35 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.268569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1529a995-b4f5-49cd-8e51-c3d73755ec35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.268569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1529a995-b4f5-49cd-8e51-c3d73755ec35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.268715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1529a995-b4f5-49cd-8e51-c3d73755ec35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.268715] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1529a995-b4f5-49cd-8e51-c3d73755ec35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.270681] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: IN_PROGRESS for 2s [ 816.287857] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.288036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.288100] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.288662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.297152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.297809] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 816.297957] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.298131] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 816.325566] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.325566] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-245" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.325566] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-245" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.326176] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-245" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.326351] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.326669] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.326864] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.327194] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.327405] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.327825] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.327825] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.327939] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.328185] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.328426] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.328494] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.328608] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.350552] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.350662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.350716] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.350968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.351994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.352233] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 816.353997] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.354299] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 816.354970] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.354970] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-245" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.354970] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-1a1459bb-01ad-40c0-95dd-cb5b840a9d04 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.355292] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-1a1459bb-01ad-40c0-95dd-cb5b840a9d04" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.355367] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-1a1459bb-01ad-40c0-95dd-cb5b840a9d04" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.355658] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-1a1459bb-01ad-40c0-95dd-cb5b840a9d04" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.355834] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a1459bb-01ad-40c0-95dd-cb5b840a9d04',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.436971] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.437344] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.437465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.437739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.437983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.438272] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 816.505291] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.505514] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.505514] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.505747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.506667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.506667] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 816.506860] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'3283bfac-7979-4949-ab5e-93112edbbd0b', '2a93339c-e2b4-45e0-a4c1-b3051b85774b', '8593ab1f-869e-4abc-aa58-bb57de585b7e', '66a8ff79-7c57-42b0-afcb-f254b5d02311', '51d37fb6-4b72-4eba-930a-b89442ed8859', 'c134d579-1162-46e0-bee7-73f3403c9135', 'b2889969-ebaf-471e-b592-cc2c82c2f544', 'f00aea48-dae0-47aa-a96c-f017c0721f54', '137495f6-8f3c-475d-b71c-88971c3781de', 'e860a997-ace0-45f9-bc64-b9fbf2d50c35', '8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a', '645b270d-e6d4-4f84-872d-3c097c5f4722', '1159257b-8ed6-4ac4-9971-8ad543ef43f9', 'e367a92f-7a4f-4e34-ac00-9e0a0c97dd76', 'bdad69f2-7aae-47fc-97ab-2b17246d7e21', 'aebfc4ad-c9f8-4810-8396-c3dbd5247dc8', '31a7bec7-75f3-4780-ac90-0f2f7e7744e9', '94d2e4ea-db97-4a0c-91d6-635a39a38e5c', '10e373b9-4e6a-452b-b0ab-03e94d0ab90a', '032cabed-a789-4100-95a3-6e4998fdb5cc', 'ffce52a9-70af-448f-a2c4-9791dde804d4', 'a240c519-0037-4bca-bd0c-b35068bcd700', '8579ac1e-c68a-42fa-957e-e205942d2fbc', '99e9e6e3-beeb-4449-ad6b-772723544abd', '35e560ef-ae12-4b78-9fd4-fb9be25e66dd', '04847a44-8459-4dcc-b6cd-80a364fba3d0', 'bfb7458a-4a70-45c1-acb5-648c53b6821a', '13d987c8-57de-4cf5-acd3-eb580bd10337', 'cb18857e-504d-46d0-8833-741cccaef5b3', '2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc', '44133d71-0f30-4e7f-9c96-2491812bcd1f', 'dba52dd6-05d0-4283-ba0e-107ad8c10157', 'f140365e-2848-4938-ba34-06e4b21ec256', 'c0fc2518-1857-49ca-8dcd-c34aaa8c5c22', '2a81501c-f74a-48d9-97d5-db6c60895c60'} {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.506860] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 816.538600] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.538700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.538757] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.538972] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.539075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.539587] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 816.539587] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.539587] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 816.606071] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.606235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.606301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.606536] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.607308] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.607512] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 816.607595] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.607664] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 816.607732] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 816.607809] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 816.607893] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGH for action security_group_rules [ 816.607971] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b with Priority: HIGH for action security_group_rules [ 816.608085] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGH for action security_group_rules [ 816.608136] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 with Priority: HIGH for action security_group_rules [ 816.608171] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGH for action security_group_rules [ 816.608231] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGH for action security_group_rules [ 816.608281] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b2889969-ebaf-471e-b592-cc2c82c2f544 with Priority: HIGH for action security_group_rules [ 816.608346] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGH for action security_group_rules [ 816.609453] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGH for action security_group_rules [ 816.609453] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGH for action security_group_rules [ 816.609453] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a with Priority: HIGH for action security_group_rules [ 816.609453] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGH for action security_group_rules [ 816.609453] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGH for action security_group_rules [ 816.609453] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 with Priority: HIGH for action security_group_rules [ 816.609453] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 with Priority: HIGH for action security_group_rules [ 816.609453] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGH for action security_group_rules [ 816.609453] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGH for action security_group_rules [ 816.609453] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGH for action security_group_rules [ 816.609453] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a with Priority: HIGH for action security_group_rules [ 816.609453] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGH for action security_group_rules [ 816.609453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.772134] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1529a995-b4f5-49cd-8e51-c3d73755ec35 [ 816.772482] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.772563] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.772676] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.772954] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.773095] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.773586] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1529a995-b4f5-49cd-8e51-c3d73755ec35 already deleted. [ 816.773586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1529a995-b4f5-49cd-8e51-c3d73755ec35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.859637] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.859637] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.859637] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.859637] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.859850] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.859850] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 1a1459bb-01ad-40c0-95dd-cb5b840a9d04 not found, creating... [ 816.860112] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.860261] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.860377] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.860586] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.860720] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.861020] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.861173] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.861285] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.861485] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.862305] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.862417] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 1a1459bb-01ad-40c0-95dd-cb5b840a9d04 is going to be created. [ 816.883674] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.884240] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.884515] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.884902] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.885673] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.885673] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-1a1459bb-01ad-40c0-95dd-cb5b840a9d04" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.683457] env[69499]: INFO networking_nsxv3.common.synchronization [req-9dc43cfa-40cc-41e5-bd98-73ffc749ab4b req-a29cff4d-d3a6-4137-b1dd-973fc9ac73ed service nova] Enqueued Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_rules [ 817.683768] env[69499]: INFO networking_nsxv3.common.synchronization [req-9dc43cfa-40cc-41e5-bd98-73ffc749ab4b req-a29cff4d-d3a6-4137-b1dd-973fc9ac73ed service nova] Enqueued Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 817.683896] env[69499]: INFO networking_nsxv3.common.synchronization [req-9dc43cfa-40cc-41e5-bd98-73ffc749ab4b req-a29cff4d-d3a6-4137-b1dd-973fc9ac73ed service nova] Enqueued Resource ID: 1a1459bb-01ad-40c0-95dd-cb5b840a9d04 with Priority: HIGHEST for action port [ 817.684593] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_rules [ 817.684784] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 817.684936] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1459bb-01ad-40c0-95dd-cb5b840a9d04 with Priority: HIGHEST for action port [ 817.685100] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3283bfac-7979-4949-ab5e-93112edbbd0b with Priority: HIGH for action security_group_rules [ 817.685249] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGH for action security_group_rules [ 817.685390] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2889969-ebaf-471e-b592-cc2c82c2f544 with Priority: HIGH for action security_group_rules [ 817.686169] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 with Priority: HIGH for action security_group_rules [ 817.686169] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGH for action security_group_rules [ 817.686169] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a with Priority: HIGH for action security_group_rules [ 817.686169] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGH for action security_group_rules [ 817.686169] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGH for action security_group_rules [ 817.686169] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 with Priority: HIGH for action security_group_rules [ 817.686558] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 with Priority: HIGH for action security_group_rules [ 817.686558] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGH for action security_group_rules [ 817.686558] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGH for action security_group_rules [ 817.686670] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a with Priority: HIGH for action security_group_rules [ 817.686750] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 with Priority: HIGH for action security_group_rules [ 817.686920] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGH for action security_group_rules [ 817.687070] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGH for action security_group_rules [ 817.687229] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGH for action security_group_rules [ 817.687384] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 with Priority: HIGH for action security_group_rules [ 817.687562] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b with Priority: HIGH for action security_group_rules [ 817.687701] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 with Priority: HIGH for action security_group_rules [ 817.688050] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.688167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.688237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.688442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.688524] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.689878] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.689878] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.690032] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a1459bb-01ad-40c0-95dd-cb5b840a9d04 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.690111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a1459bb-01ad-40c0-95dd-cb5b840a9d04" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.690147] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a1459bb-01ad-40c0-95dd-cb5b840a9d04" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.690311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a1459bb-01ad-40c0-95dd-cb5b840a9d04" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.690387] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a1459bb-01ad-40c0-95dd-cb5b840a9d04',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.691198] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3283bfac-7979-4949-ab5e-93112edbbd0b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.691315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.691383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.691615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.691734] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3283bfac-7979-4949-ab5e-93112edbbd0b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.692559] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8593ab1f-869e-4abc-aa58-bb57de585b7e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.692702] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.692817] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.693096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.693170] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.694306] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2889969-ebaf-471e-b592-cc2c82c2f544 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.694447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.694519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.696400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.696400] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2889969-ebaf-471e-b592-cc2c82c2f544',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.696400] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdad69f2-7aae-47fc-97ab-2b17246d7e21 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.696400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.696400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.696400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.696400] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdad69f2-7aae-47fc-97ab-2b17246d7e21',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.697262] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-032cabed-a789-4100-95a3-6e4998fdb5cc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.697326] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.697361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.698102] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.698102] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('032cabed-a789-4100-95a3-6e4998fdb5cc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.698458] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.698575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.698632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.698777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.698850] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10e373b9-4e6a-452b-b0ab-03e94d0ab90a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.700209] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.700319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.700650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.700650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.700650] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.701644] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.701765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.701831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.701987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.702073] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.702966] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.703160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.703270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.703921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.703921] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e367a92f-7a4f-4e34-ac00-9e0a0c97dd76',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.704204] env[69499]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 817.704708] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.704806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.704865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.705235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.706353] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aebfc4ad-c9f8-4810-8396-c3dbd5247dc8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.706811] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.706950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.707022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.707186] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.707264] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1159257b-8ed6-4ac4-9971-8ad543ef43f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.708176] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.708306] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.708357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.708581] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.708581] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.709615] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.710294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.710294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.710294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.710294] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.710874] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.710977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.711042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.711205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.711279] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e860a997-ace0-45f9-bc64-b9fbf2d50c35',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.712131] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.712251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.712304] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.712506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.712581] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.713498] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c134d579-1162-46e0-bee7-73f3403c9135 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.713600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.713670] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.713823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.713891] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c134d579-1162-46e0-bee7-73f3403c9135',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.715161] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.715161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.715161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.715161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.715161] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.716021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51d37fb6-4b72-4eba-930a-b89442ed8859 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.716123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.716193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.716350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.716420] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51d37fb6-4b72-4eba-930a-b89442ed8859',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.717328] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a93339c-e2b4-45e0-a4c1-b3051b85774b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.717485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.717564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.717725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.717787] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a93339c-e2b4-45e0-a4c1-b3051b85774b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.718057] env[69499]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 817.718701] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66a8ff79-7c57-42b0-afcb-f254b5d02311 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.718799] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.718870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.719049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.719169] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66a8ff79-7c57-42b0-afcb-f254b5d02311',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.722422] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.722534] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.725141] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a1459bb-01ad-40c0-95dd-cb5b840a9d04 with status ACTIVE [ 817.725290] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.725373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.725416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.725597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.725663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.725913] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.726066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.726139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.726294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.726374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.726565] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.726661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.726725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.726863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.726938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.727034] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a1459bb-01ad-40c0-95dd-cb5b840a9d04 is going to be updated. [ 817.883497] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.884824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.884824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.884824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.884824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.884824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a1459bb-01ad-40c0-95dd-cb5b840a9d04" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.886739] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.886739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.886739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.886739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.914516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.914516] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3283bfac-7979-4949-ab5e-93112edbbd0b is going to be deleted. [ 817.967151] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.967285] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.967346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.967557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.967643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.967750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3283bfac-7979-4949-ab5e-93112edbbd0b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.280302] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: SUCCESS [ 818.280473] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 deletion is rescheduled due to dependency. [ 818.280622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.280819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.281073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.281259] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.281374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.281460] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.281583] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.281669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.281808] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.324072] env[69499]: INFO networking_nsxv3.common.synchronization [req-f444bb18-32c2-44da-97c8-94362119e6c6 req-2ef2bea5-94a8-477a-affe-64f159bd1551 tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_members [ 818.324607] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_members [ 818.324923] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b93818-38bc-46b2-af63-51d39fce766c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.325061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.325126] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.325374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.325529] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.325622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.325681] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.325831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.325914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.326010] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.401072] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-032cabed-a789-4100-95a3-6e4998fdb5cc taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.401072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.401072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.402366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.402366] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.402366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.402366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.402366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.402366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.402366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.402366] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('032cabed-a789-4100-95a3-6e4998fdb5cc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.404798] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.404798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.404962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.405070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.405179] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.405280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.405339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.405482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.405570] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.405667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.405730] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.407328] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.407328] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.407328] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.407570] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.407608] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.407695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.407749] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.409022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.409022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.409022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.409022] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.411122] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.411270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.411366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.412018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.412018] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.412018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.412018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.412018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.412018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.412455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.412455] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.415939] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.416117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.416200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.417089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.417089] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.417089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.417089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.417089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.417089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.417089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.417089] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.417689] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c134d579-1162-46e0-bee7-73f3403c9135 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.417798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.417869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.422303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.422303] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.422303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.422303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.422303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.422303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.422303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.422303] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c134d579-1162-46e0-bee7-73f3403c9135',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.422303] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.422303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.422303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.422303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.422303] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.422303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.422303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.422303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.422303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.422303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.423078] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10e373b9-4e6a-452b-b0ab-03e94d0ab90a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.423500] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1159257b-8ed6-4ac4-9971-8ad543ef43f9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.423620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.423684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.423841] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.423980] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.424080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.424139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.424293] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.424400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.424443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.424510] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1159257b-8ed6-4ac4-9971-8ad543ef43f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.431760] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.431888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.431968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.432179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.432351] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.432451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.432512] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.432664] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.432739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.432823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.432965] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.433077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.433136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.433279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.433467] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.433532] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.433566] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.433735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.433786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.433829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.433908] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.468956] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.468956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.468956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.468956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.470620] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.470723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.471466] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.471585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.472214] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.472417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.472997] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.473202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.475348] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.475348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.475348] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.475348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.475348] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.475861] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.476167] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.476258] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.477581] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.477675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.478441] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.478539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.492423] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 818.492936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.493088] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e367a92f-7a4f-4e34-ac00-9e0a0c97dd76 is going to be deleted. [ 818.494543] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.494749] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.510947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.511266] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51d37fb6-4b72-4eba-930a-b89442ed8859 is going to be deleted. [ 818.513072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.513769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.529834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.530604] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdad69f2-7aae-47fc-97ab-2b17246d7e21 is going to be deleted. [ 818.532509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.536081] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.549624] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.549739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.552678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.552805] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2889969-ebaf-471e-b592-cc2c82c2f544 is going to be deleted. [ 818.553704] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.553908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.571480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.571838] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a is going to be deleted. [ 818.573594] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.573594] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.579434] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.579564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.587430] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.587602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.595877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.596122] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aebfc4ad-c9f8-4810-8396-c3dbd5247dc8 is going to be deleted. [ 818.597080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.597297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.605756] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.605891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.619270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.619270] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e860a997-ace0-45f9-bc64-b9fbf2d50c35 is going to be deleted. [ 818.620633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.621232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.659302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.659452] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e is going to be deleted. [ 818.660462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.660582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.662723] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.663261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.688752] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.689075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.704282] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.704526] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.704660] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.704935] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.705224] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.705465] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.705505] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.705722] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.705871] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.706148] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 818.706274] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 818.706571] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 818.706571] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 818.706674] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 818.707686] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 818.707686] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 818.745433] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 818.745433] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 818.745433] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 818.745433] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.745614] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-d75f5c76-12b2-4c89-bfc3-464fe904f9f8 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.745695] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-d75f5c76-12b2-4c89-bfc3-464fe904f9f8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.745913] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-d75f5c76-12b2-4c89-bfc3-464fe904f9f8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.746411] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-d75f5c76-12b2-4c89-bfc3-464fe904f9f8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.746688] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d75f5c76-12b2-4c89-bfc3-464fe904f9f8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.748110] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.748316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.773615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.773615] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a93339c-e2b4-45e0-a4c1-b3051b85774b is going to be deleted. [ 818.774377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.774583] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.784148] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.807690] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.807829] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be deleted. [ 818.808772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.809018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.828652] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.828778] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.860997] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.861158] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.867847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.868070] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66a8ff79-7c57-42b0-afcb-f254b5d02311 is going to be deleted. [ 818.869295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.869396] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.869437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.869520] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e367a92f-7a4f-4e34-ac00-9e0a0c97dd76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.869666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.869815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.869888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.870009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdad69f2-7aae-47fc-97ab-2b17246d7e21" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.870611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.870798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51d37fb6-4b72-4eba-930a-b89442ed8859" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2889969-ebaf-471e-b592-cc2c82c2f544" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a8ac0ef-1f70-4f51-be2f-e5b553aaf05a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aebfc4ad-c9f8-4810-8396-c3dbd5247dc8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.873022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.873630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.873630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e860a997-ace0-45f9-bc64-b9fbf2d50c35" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.873630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.873630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.873630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.873890] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.874075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.874140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.874318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.874393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.874487] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2b93818-38bc-46b2-af63-51d39fce766c already deleted. [ 818.874565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.874761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.877929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.877929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.877929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.883931] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.884074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.884141] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.884325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.884411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.884575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a93339c-e2b4-45e0-a4c1-b3051b85774b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.907144] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('032cabed-a789-4100-95a3-6e4998fdb5cc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.929172] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.930235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.930235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.930235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.930235] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.930235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.930235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.930235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.930665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.930665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.930665] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.930665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.930665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.930850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.931046] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.931046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.931163] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.932145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.932145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.932145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.932145] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.932415] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c134d579-1162-46e0-bee7-73f3403c9135',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.933164] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1159257b-8ed6-4ac4-9971-8ad543ef43f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.938287] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.938287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.938287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.938287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.938287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.938287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.938287] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.938287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.938287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.938715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.938715] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.938715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.938715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.938715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.938945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.938945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.939075] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.939132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.939169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.939364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.939483] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.939573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.939632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.939772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.939837] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.939923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.940016] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.942599] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.942599] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.942599] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.942808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.942808] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.942889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.942925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.943075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.943149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.943317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.943373] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.947024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.947024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.947024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.947024] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.947024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.947024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.947024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.947024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.947024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.947024] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.947024] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.947024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.947024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.947024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.947024] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.947024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.947024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.947024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.947865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.947865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.947865] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.947865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.947865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.947865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.947865] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.947865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.947865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.947865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.947865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.947865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.947865] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10e373b9-4e6a-452b-b0ab-03e94d0ab90a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.948725] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 137495f6-8f3c-475d-b71c-88971c3781de: rpc.has_security_group_logging(os_id): False [ 819.055989] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.055989] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.055989] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.055989] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.055989] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.056276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66a8ff79-7c57-42b0-afcb-f254b5d02311" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.060253] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.060556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.061114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.061114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.099800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.099800] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.099800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.099800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.100042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.100084] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.101027] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.101027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.101027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.101027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.101027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.101027] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.101027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.101027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.101385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.101385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.101385] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 819.211845] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.212038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.212092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.212273] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.212601] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.227332] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 819.250056] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.250283] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.250423] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.250700] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.250857] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.251533] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port d75f5c76-12b2-4c89-bfc3-464fe904f9f8 not found, creating... [ 819.251533] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.251533] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.251533] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.251813] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.251903] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.252205] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.252367] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.252488] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.252694] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.252832] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.252976] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: d75f5c76-12b2-4c89-bfc3-464fe904f9f8 is going to be created. [ 819.276018] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.276221] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.276353] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.276602] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.276830] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.277169] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-d75f5c76-12b2-4c89-bfc3-464fe904f9f8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.285932] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.409895] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 032cabed-a789-4100-95a3-6e4998fdb5cc: rpc.has_security_group_logging(os_id): False [ 819.429940] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.430162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.430162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.430357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.434732] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f00aea48-dae0-47aa-a96c-f017c0721f54: rpc.has_security_group_logging(os_id): False [ 819.435600] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1159257b-8ed6-4ac4-9971-8ad543ef43f9: rpc.has_security_group_logging(os_id): False [ 819.436385] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c134d579-1162-46e0-bee7-73f3403c9135: rpc.has_security_group_logging(os_id): False [ 819.448970] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 645b270d-e6d4-4f84-872d-3c097c5f4722: rpc.has_security_group_logging(os_id): False [ 819.449750] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94d2e4ea-db97-4a0c-91d6-635a39a38e5c: rpc.has_security_group_logging(os_id): False [ 819.450537] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10e373b9-4e6a-452b-b0ab-03e94d0ab90a: rpc.has_security_group_logging(os_id): False [ 819.453630] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.453722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.454443] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.454533] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.455186] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.455282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.475748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.476028] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.476127] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.476189] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.476386] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.476497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.476599] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 032cabed-a789-4100-95a3-6e4998fdb5cc is going to be updated. [ 819.477776] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.477949] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.481341] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.481445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.482081] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.482179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.487383] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.487481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.506921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.508342] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.508342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.508342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.508342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.508342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.508342] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.508342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.508342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.508729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.508729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.508729] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.508846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.508846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.508988] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.509065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.509181] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f00aea48-dae0-47aa-a96c-f017c0721f54 is going to be updated. [ 819.510288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.510454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.543193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.543193] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.543193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.543193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.543484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.543484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.543484] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c134d579-1162-46e0-bee7-73f3403c9135 is going to be updated. [ 819.545030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.545030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.563471] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.563471] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.566084] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.566706] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.566706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.566706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.566706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.566706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.566961] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.567102] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.567102] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.567218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.567258] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.567437] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.567515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.567581] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.567795] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.567795] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.567935] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a is going to be updated. [ 819.569178] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.569495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.593637] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.593761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.596372] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.596631] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.596754] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.596822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.597043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.597133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.597348] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.597445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.597525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.597658] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.597734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.597932] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.598069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.598167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.598317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.598421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.598556] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be updated. [ 819.599600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.599843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.636192] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.636284] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.668473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.668800] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.668959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.669045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.669290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.669424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.669618] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.669734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.669814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.669985] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.670091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.670301] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.670404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.670477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.670628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.670707] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.670808] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c is going to be updated. [ 819.672108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.672314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.692738] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.693037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.701445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.701826] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.701940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.702041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.702812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.702812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.702812] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 is going to be updated. [ 819.703515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.703675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.703858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.704920] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.705104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.705277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.706289] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.706446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.707036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.707405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.707568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.707692] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.724282] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a in Status: IN_PROGRESS for 2s [ 819.734442] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c134d579-1162-46e0-bee7-73f3403c9135 in Status: IN_PROGRESS for 2s [ 819.740158] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 032cabed-a789-4100-95a3-6e4998fdb5cc in Status: IN_PROGRESS for 2s [ 819.741945] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: IN_PROGRESS for 2s [ 819.788812] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.789024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.789206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.789444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.789747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.789747] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 is going to be updated. [ 819.808286] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.808286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.809400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.809400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.809400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.834950] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 819.848724] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.848817] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.848859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.849147] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.849312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.855080] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.855274] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.855274] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.855452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.855588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.864120] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.864120] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.864798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.864798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.864798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.866160] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: IN_PROGRESS for 2s [ 819.868703] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: IN_PROGRESS for 2s [ 819.902155] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 in Status: IN_PROGRESS for 2s [ 820.002149] env[69499]: INFO networking_nsxv3.common.synchronization [req-dcf0d4ea-bf3d-495f-ac00-b91a1a536899 req-3dd80f94-7c88-49f0-b762-4eb3a41c5190 tempest-ServerDiagnosticsTest-940307894 tempest-ServerDiagnosticsTest-940307894-project-member] Enqueued Resource ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a with Priority: HIGHEST for action security_group_members [ 820.002663] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a with Priority: HIGHEST for action security_group_members [ 820.002962] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.003418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.003534] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.003642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.003810] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.003955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.004017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.004126] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.004227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.004303] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e373b9-4e6a-452b-b0ab-03e94d0ab90a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.013767] env[69499]: INFO networking_nsxv3.common.synchronization [req-f444bb18-32c2-44da-97c8-94362119e6c6 req-fe2bfa86-acd5-42fe-80f6-bc61108ad122 service nova] Enqueued Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_rules [ 820.013952] env[69499]: INFO networking_nsxv3.common.synchronization [req-f444bb18-32c2-44da-97c8-94362119e6c6 req-fe2bfa86-acd5-42fe-80f6-bc61108ad122 service nova] Enqueued Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_members [ 820.014107] env[69499]: INFO networking_nsxv3.common.synchronization [req-f444bb18-32c2-44da-97c8-94362119e6c6 req-fe2bfa86-acd5-42fe-80f6-bc61108ad122 service nova] Enqueued Resource ID: d75f5c76-12b2-4c89-bfc3-464fe904f9f8 with Priority: HIGHEST for action port [ 820.014331] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_rules [ 820.014457] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_members [ 820.014555] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d75f5c76-12b2-4c89-bfc3-464fe904f9f8 with Priority: HIGHEST for action port [ 820.015065] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2b93818-38bc-46b2-af63-51d39fce766c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.015190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.015264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.015488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.015569] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.017581] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b93818-38bc-46b2-af63-51d39fce766c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.017641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.017847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.017938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.018015] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.018139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.018208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.018360] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.018488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.018542] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.019271] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-d75f5c76-12b2-4c89-bfc3-464fe904f9f8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.019380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d75f5c76-12b2-4c89-bfc3-464fe904f9f8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.019507] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d75f5c76-12b2-4c89-bfc3-464fe904f9f8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.019622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d75f5c76-12b2-4c89-bfc3-464fe904f9f8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.019698] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d75f5c76-12b2-4c89-bfc3-464fe904f9f8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.507390] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.507561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.507635] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.507855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.507951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.508212] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.508314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.508380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.508535] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.508615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.508705] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a is going to be updated. [ 820.523068] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.525629] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b93818-38bc-46b2-af63-51d39fce766c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.525763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.525908] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d75f5c76-12b2-4c89-bfc3-464fe904f9f8 with status ACTIVE [ 820.526084] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.526190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.526252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.526429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.526512] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.526700] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.526806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.526862] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.527011] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.527084] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.527263] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.527354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.527413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.527546] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.527618] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.527717] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d75f5c76-12b2-4c89-bfc3-464fe904f9f8 is going to be updated. [ 820.561498] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.561653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.561709] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.561892] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.562044] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.563670] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.563769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.563849] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.563990] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.564109] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.564346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d75f5c76-12b2-4c89-bfc3-464fe904f9f8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.571158] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a in Status: IN_PROGRESS for 2s [ 821.029776] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.244026] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 821.244188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.532481] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.532710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.532710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.532987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.533106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.533245] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2b93818-38bc-46b2-af63-51d39fce766c is going to be created. [ 821.556407] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.556552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.556622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.556825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.556981] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.568915] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2b93818-38bc-46b2-af63-51d39fce766c in Status: UNINITIALIZED for 2s [ 821.742921] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a in Status: SUCCESS [ 821.743169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.762057] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c134d579-1162-46e0-bee7-73f3403c9135 in Status: SUCCESS [ 821.762057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.762410] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 032cabed-a789-4100-95a3-6e4998fdb5cc in Status: SUCCESS [ 821.762410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.763722] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: SUCCESS [ 821.763897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.851083] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 821.851309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.879615] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: SUCCESS [ 821.879615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.879615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.879615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.879615] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.879615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.879615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.879615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.879615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.879615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.879615] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.881671] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: SUCCESS [ 821.881948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.912337] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 in Status: SUCCESS [ 821.912603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.383637] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.383936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.383936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.384110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.384282] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.384968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.385128] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.385305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.385395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.385488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.385640] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.385735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.385829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.385933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.386098] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.386193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.386252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.386385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.386456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.386535] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.386621] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.582925] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a in Status: SUCCESS [ 822.583104] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a deletion is rescheduled due to dependency. [ 822.583216] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.888684] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13d987c8-57de-4cf5-acd3-eb580bd10337: rpc.has_security_group_logging(os_id): False [ 822.906147] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.906312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.906384] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.906600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.938331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.938614] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.938748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.938904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.939048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.939145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.939340] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.939440] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.939503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.939662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.939738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.939915] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.940016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.940083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.940227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.940302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.940389] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 is going to be updated. [ 822.997721] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.997721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.997721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.997936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.998134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.016392] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: IN_PROGRESS for 2s [ 823.579777] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2b93818-38bc-46b2-af63-51d39fce766c in Status: SUCCESS [ 823.580103] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.580227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.580461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.580659] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.580775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.580842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.580998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.581094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.581184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.581273] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.083837] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b93818-38bc-46b2-af63-51d39fce766c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.084009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.084100] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.084324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.084494] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.084593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.084659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.084804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.084893] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.084998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.085138] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b93818-38bc-46b2-af63-51d39fce766c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.085235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.085297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.085429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.085569] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.085656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.085719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.085909] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.085983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.086049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.086127] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.588748] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2b93818-38bc-46b2-af63-51d39fce766c: rpc.has_security_group_logging(os_id): False [ 824.605375] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.605521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.606077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.606077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.606077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.606077] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.606341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.606341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.606434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.606479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.606659] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.606752] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.606819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.606947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.607033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.607215] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.607303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.607371] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.607521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.607565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.607644] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2b93818-38bc-46b2-af63-51d39fce766c is going to be created. [ 824.660176] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.660346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.660417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.660673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.662355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.675800] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2b93818-38bc-46b2-af63-51d39fce766c in Status: IN_PROGRESS for 2s [ 825.015988] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 825.015988] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 825.026966] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: SUCCESS [ 825.026966] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.449951] env[69499]: INFO networking_nsxv3.common.synchronization [req-d4bff1ad-b30b-4cbf-8a5a-f298bb94842d req-ed0cdd4a-d2bc-4dc9-a1eb-ccc5561d2075 tempest-VolumesAdminNegativeTest-1747404511 tempest-VolumesAdminNegativeTest-1747404511-project-member] Enqueued Resource ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 with Priority: HIGHEST for action security_group_members [ 826.453305] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 with Priority: HIGHEST for action security_group_members [ 826.453305] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.453305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.453305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.453305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.453305] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.453305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.453305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.453305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.453305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.453305] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.692887] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2b93818-38bc-46b2-af63-51d39fce766c in Status: SUCCESS [ 826.692887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.873995] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.874258] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-353" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.874347] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-353" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.874638] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-353" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.874916] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.875149] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.875291] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.875524] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.875714] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.875945] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 826.876575] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.876575] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.876575] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.876575] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 826.876808] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.876808] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.894267] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.894544] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 826.894648] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.894827] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-353" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.895178] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-8eaa4a23-ef69-4441-bba1-f0edad9e8442 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.895356] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-8eaa4a23-ef69-4441-bba1-f0edad9e8442" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.895481] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-8eaa4a23-ef69-4441-bba1-f0edad9e8442" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.895849] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-8eaa4a23-ef69-4441-bba1-f0edad9e8442" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.896043] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eaa4a23-ef69-4441-bba1-f0edad9e8442',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.954582] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.955153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.955153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.955153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.955153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.955407] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.955466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.955561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.957041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.957041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.957041] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 already deleted. [ 826.957041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.400109] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.400353] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.400511] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.400814] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.400965] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.401151] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 8eaa4a23-ef69-4441-bba1-f0edad9e8442 not found, creating... [ 827.402183] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.402183] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.402183] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.402183] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.402421] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.402555] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.402900] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.402900] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.403048] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.403140] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.404032] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 8eaa4a23-ef69-4441-bba1-f0edad9e8442 is going to be created. [ 827.427194] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.427194] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.427194] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.427194] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.427194] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.427194] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-8eaa4a23-ef69-4441-bba1-f0edad9e8442" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.152166] env[69499]: INFO networking_nsxv3.common.synchronization [req-d4bff1ad-b30b-4cbf-8a5a-f298bb94842d req-0d067719-e847-4df6-803a-cc2dbb507bf2 service nova] Enqueued Resource ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 with Priority: HIGHEST for action security_group_rules [ 828.152166] env[69499]: INFO networking_nsxv3.common.synchronization [req-d4bff1ad-b30b-4cbf-8a5a-f298bb94842d req-0d067719-e847-4df6-803a-cc2dbb507bf2 service nova] Enqueued Resource ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 with Priority: HIGHEST for action security_group_members [ 828.152166] env[69499]: INFO networking_nsxv3.common.synchronization [req-d4bff1ad-b30b-4cbf-8a5a-f298bb94842d req-0d067719-e847-4df6-803a-cc2dbb507bf2 service nova] Enqueued Resource ID: 8eaa4a23-ef69-4441-bba1-f0edad9e8442 with Priority: HIGHEST for action port [ 828.152619] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 with Priority: HIGHEST for action security_group_rules [ 828.152780] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 with Priority: HIGHEST for action security_group_members [ 828.152910] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eaa4a23-ef69-4441-bba1-f0edad9e8442 with Priority: HIGHEST for action port [ 828.153792] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.153968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.153968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.154571] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.154571] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.155161] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.155433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.155433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.155621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.155817] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.155817] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.156051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.156051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.156230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.156230] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.157015] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-8eaa4a23-ef69-4441-bba1-f0edad9e8442 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.158142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8eaa4a23-ef69-4441-bba1-f0edad9e8442" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.158723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8eaa4a23-ef69-4441-bba1-f0edad9e8442" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.158723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8eaa4a23-ef69-4441-bba1-f0edad9e8442" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.158723] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eaa4a23-ef69-4441-bba1-f0edad9e8442',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.660593] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.661627] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.661627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.661627] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8eaa4a23-ef69-4441-bba1-f0edad9e8442 with status ACTIVE [ 828.661930] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.661930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.661930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.662130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.662221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.662388] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.662504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.662544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.662762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.662834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.662951] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.663152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.663219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.663367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.663437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.663525] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8eaa4a23-ef69-4441-bba1-f0edad9e8442 is going to be updated. [ 828.683853] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.683984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.684090] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.684293] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.684421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.685030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8eaa4a23-ef69-4441-bba1-f0edad9e8442" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.166047] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.170364] env[69499]: INFO networking_nsxv3.common.synchronization [req-4c8d11af-bd80-4aab-9b08-fcc36f707e52 req-23435702-1493-4ab8-aa2d-217f93004b58 tempest-ServerRescueNegativeTestJSON-106874270 tempest-ServerRescueNegativeTestJSON-106874270-project-member] Enqueued Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_members [ 829.170364] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_members [ 829.170364] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-478dd7f8-67f8-49a4-9685-e070fbf463f1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.170364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.170364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.170364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.170821] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.170821] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.170821] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.170978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.171515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.171515] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.541766] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-666 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.542042] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-666" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.542298] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-666" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.542638] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-666" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.543041] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.543445] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.543445] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.543742] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.543959] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.544252] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.544418] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.544575] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.544848] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.544959] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.545042] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.545228] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.563296] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.563539] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 829.563744] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.563992] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-666" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.564443] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-52aca7fb-a4f6-44fc-9f22-a342972f5a20 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.564682] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-52aca7fb-a4f6-44fc-9f22-a342972f5a20" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.565787] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-52aca7fb-a4f6-44fc-9f22-a342972f5a20" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.565787] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-52aca7fb-a4f6-44fc-9f22-a342972f5a20" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.565787] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52aca7fb-a4f6-44fc-9f22-a342972f5a20',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.667953] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.668230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.668350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.668523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.668611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.668736] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 is going to be created. [ 829.673707] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.673847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.673917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.674140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.674246] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.674432] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.674530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.674595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.674749] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.674816] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.674900] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 already deleted. [ 829.674980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.692330] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.692480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.692523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.692800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.693048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.701596] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 in Status: UNINITIALIZED for 2s [ 830.068515] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.068789] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.068882] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.069234] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.069405] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.069571] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 52aca7fb-a4f6-44fc-9f22-a342972f5a20 not found, creating... [ 830.069819] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.069982] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.070123] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.070349] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.070493] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.070825] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.070990] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.071124] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.071376] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.071521] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.071667] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 52aca7fb-a4f6-44fc-9f22-a342972f5a20 is going to be created. [ 830.093232] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.093456] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.093586] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.093865] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.094225] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.094344] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-52aca7fb-a4f6-44fc-9f22-a342972f5a20" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.784558] env[69499]: INFO networking_nsxv3.common.synchronization [req-4c8d11af-bd80-4aab-9b08-fcc36f707e52 req-bde16d01-9093-4b19-9d5b-d0fd8d0e19ec service nova] Enqueued Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_rules [ 830.784795] env[69499]: INFO networking_nsxv3.common.synchronization [req-4c8d11af-bd80-4aab-9b08-fcc36f707e52 req-bde16d01-9093-4b19-9d5b-d0fd8d0e19ec service nova] Enqueued Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_members [ 830.785735] env[69499]: INFO networking_nsxv3.common.synchronization [req-4c8d11af-bd80-4aab-9b08-fcc36f707e52 req-bde16d01-9093-4b19-9d5b-d0fd8d0e19ec service nova] Enqueued Resource ID: 52aca7fb-a4f6-44fc-9f22-a342972f5a20 with Priority: HIGHEST for action port [ 830.786874] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_rules [ 830.786874] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_members [ 830.786874] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52aca7fb-a4f6-44fc-9f22-a342972f5a20 with Priority: HIGHEST for action port [ 830.788280] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-478dd7f8-67f8-49a4-9685-e070fbf463f1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.788440] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.792684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.792967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.793073] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.795579] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-478dd7f8-67f8-49a4-9685-e070fbf463f1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.795579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.795579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.795579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.795579] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.795579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.795579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.795579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.795579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.795579] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.796815] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-52aca7fb-a4f6-44fc-9f22-a342972f5a20 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.796964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52aca7fb-a4f6-44fc-9f22-a342972f5a20" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.797075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52aca7fb-a4f6-44fc-9f22-a342972f5a20" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.797290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52aca7fb-a4f6-44fc-9f22-a342972f5a20" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.797395] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52aca7fb-a4f6-44fc-9f22-a342972f5a20',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.298844] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-478dd7f8-67f8-49a4-9685-e070fbf463f1 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.299061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.299176] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.302615] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52aca7fb-a4f6-44fc-9f22-a342972f5a20 with status ACTIVE [ 831.302803] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.302919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.302984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.303205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.303290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.303458] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.303588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.303655] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.303826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.303915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.304115] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.304213] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.304275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.304417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.304491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.304575] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52aca7fb-a4f6-44fc-9f22-a342972f5a20 is going to be updated. [ 831.324159] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.324407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.324505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.324730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.324876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.325073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52aca7fb-a4f6-44fc-9f22-a342972f5a20" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.713030] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 in Status: SUCCESS [ 831.713030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.713030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.713030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.713030] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.713030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.713030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.713030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.713030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.713030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.713030] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.801708] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.214405] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.214663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.214719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.214969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.215214] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.215358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.215540] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.215755] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.215923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.216015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.216212] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.216327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.216408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.216587] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.216801] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.216951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.217105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.217236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.217341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.217432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.217559] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.306232] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.306232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.306232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.306232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.306232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.306232] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 is going to be created. [ 832.328463] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.329424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.329424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.330498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.331274] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.340801] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 in Status: UNINITIALIZED for 2s [ 832.720016] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5: rpc.has_security_group_logging(os_id): False [ 832.736993] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.737170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.737246] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.737465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.737557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.737771] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.737871] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.737935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.738101] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.738201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.738391] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.738487] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.738545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.738690] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.738760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.738934] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.739041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.739104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.739244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.739319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.739405] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 is going to be created. [ 832.796277] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.796529] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.796529] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.796695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.796955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.806573] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 in Status: IN_PROGRESS for 2s [ 834.005588] env[69499]: INFO networking_nsxv3.common.synchronization [req-b8a3562d-de45-475f-9861-66514a243461 req-36723deb-5312-4a7d-82fc-c4571a66b3aa tempest-ServerRescueNegativeTestJSON-106874270 tempest-ServerRescueNegativeTestJSON-106874270-project-member] Enqueued Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_members [ 834.007110] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_members [ 834.007110] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-478dd7f8-67f8-49a4-9685-e070fbf463f1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.007110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.352043] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 in Status: SUCCESS [ 834.352043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.352043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.352043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.352043] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.352043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.352043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.352043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.352043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.352043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.352043] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.353522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.353853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.354327] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.354603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.358761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.358761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.358761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.358761] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.454884] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-666 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.454884] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-666" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.454884] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-666" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.455386] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-666" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.455849] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.456075] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.456364] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.456645] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.456803] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.457043] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 834.457169] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 834.457293] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 834.457438] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 834.457615] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 834.457796] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 834.457950] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 834.476878] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 834.477073] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 834.477220] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 834.477403] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-666" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.477723] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-3d7a88e0-b5b6-4756-b118-e200fb7f2835 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.477894] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-3d7a88e0-b5b6-4756-b118-e200fb7f2835" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.478026] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-3d7a88e0-b5b6-4756-b118-e200fb7f2835" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.478441] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-3d7a88e0-b5b6-4756-b118-e200fb7f2835" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.478542] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d7a88e0-b5b6-4756-b118-e200fb7f2835',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.576996] env[69499]: INFO networking_nsxv3.common.synchronization [req-95160485-8d0c-4b70-ab33-73450cfd6ca4 req-89a9be89-8f76-4694-8ddd-06755ae6ca0a tempest-VolumesAssistedSnapshotsTest-628391310 tempest-VolumesAssistedSnapshotsTest-628391310-project-member] Enqueued Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGHEST for action security_group_members [ 834.577771] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGHEST for action security_group_members [ 834.581286] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-032cabed-a789-4100-95a3-6e4998fdb5cc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.581436] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.581509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.581844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.582079] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.582248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.582352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.582776] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.582776] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.582952] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032cabed-a789-4100-95a3-6e4998fdb5cc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.818717] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 in Status: SUCCESS [ 834.818717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.854094] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-478dd7f8-67f8-49a4-9685-e070fbf463f1 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.854294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.860745] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.988025] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.988025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.988025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.988025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.988025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.988025] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 3d7a88e0-b5b6-4756-b118-e200fb7f2835 not found, creating... [ 834.988025] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.988025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.988025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.988786] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.989085] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.989648] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.990037] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.990317] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.990687] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.991065] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.991553] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 3d7a88e0-b5b6-4756-b118-e200fb7f2835 is going to be created. [ 835.011977] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.011977] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.011977] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.011977] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.011977] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.011977] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-3d7a88e0-b5b6-4756-b118-e200fb7f2835" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.087941] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.088400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.088523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.088691] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.088788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.089017] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.089353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.089353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.089353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.089490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.089490] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032cabed-a789-4100-95a3-6e4998fdb5cc is going to be updated. [ 835.141877] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.142143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.142143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.142368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.142529] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.154758] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032cabed-a789-4100-95a3-6e4998fdb5cc in Status: IN_PROGRESS for 2s [ 835.366522] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.781869] env[69499]: INFO networking_nsxv3.common.synchronization [req-b8a3562d-de45-475f-9861-66514a243461 req-0693bedc-9a7c-4323-87bb-640132e35af0 service nova] Enqueued Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_rules [ 835.781869] env[69499]: INFO networking_nsxv3.common.synchronization [req-b8a3562d-de45-475f-9861-66514a243461 req-0693bedc-9a7c-4323-87bb-640132e35af0 service nova] Enqueued Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_members [ 835.782104] env[69499]: INFO networking_nsxv3.common.synchronization [req-b8a3562d-de45-475f-9861-66514a243461 req-0693bedc-9a7c-4323-87bb-640132e35af0 service nova] Enqueued Resource ID: 3d7a88e0-b5b6-4756-b118-e200fb7f2835 with Priority: HIGHEST for action port [ 835.782265] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_rules [ 835.782401] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_members [ 835.782500] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d7a88e0-b5b6-4756-b118-e200fb7f2835 with Priority: HIGHEST for action port [ 835.786340] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-478dd7f8-67f8-49a4-9685-e070fbf463f1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.786340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.786458] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-478dd7f8-67f8-49a4-9685-e070fbf463f1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.786542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.786729] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d7a88e0-b5b6-4756-b118-e200fb7f2835 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.786827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d7a88e0-b5b6-4756-b118-e200fb7f2835" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.786891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d7a88e0-b5b6-4756-b118-e200fb7f2835" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.787216] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d7a88e0-b5b6-4756-b118-e200fb7f2835" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.787216] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d7a88e0-b5b6-4756-b118-e200fb7f2835',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.869661] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.869912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.869912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.870165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.870259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.870371] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 is going to be updated. [ 835.897699] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.897904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.897976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.898222] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.898375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.908484] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 in Status: IN_PROGRESS for 2s [ 836.289210] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d7a88e0-b5b6-4756-b118-e200fb7f2835 with status ACTIVE [ 836.289530] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.289624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.289717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.289914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.290015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.290228] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.290332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.290407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.290573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.290653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.290842] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.290937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.291050] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.291154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.291233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.291318] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d7a88e0-b5b6-4756-b118-e200fb7f2835 is going to be updated. [ 836.319039] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.319039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.319039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.319039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.319039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.319039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d7a88e0-b5b6-4756-b118-e200fb7f2835" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.163695] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032cabed-a789-4100-95a3-6e4998fdb5cc in Status: SUCCESS [ 837.163695] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032cabed-a789-4100-95a3-6e4998fdb5cc deletion is rescheduled due to dependency. [ 837.163695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.924336] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 in Status: SUCCESS [ 837.924703] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.924898] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.925491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.925491] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.925699] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.925699] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.926035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.926035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.926279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.926388] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-478dd7f8-67f8-49a4-9685-e070fbf463f1 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.926642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.926642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.927232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.927232] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.927232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.927232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.927232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.927232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.927569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.927569] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.928708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.928708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.928708] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.928708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.929187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.929187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.929187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.929187] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.431022] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 478dd7f8-67f8-49a4-9685-e070fbf463f1: rpc.has_security_group_logging(os_id): False [ 838.432170] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.449689] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.449859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.449905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.450111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.450194] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.450408] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.450506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.450572] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.450731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.450808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.450971] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.451072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.451128] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.451399] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.451399] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.451546] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.451603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.451671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.451790] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.451858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.451943] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 is going to be created. [ 838.507539] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.507696] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.507744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.507930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.508126] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.517796] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 in Status: IN_PROGRESS for 2s [ 838.838362] env[69499]: INFO networking_nsxv3.common.synchronization [req-7ce24d74-25d3-4bf9-8c09-5dbbb8c2f58d req-43e612bd-2e84-4444-92ca-aa6146e3065c tempest-ServersTestMultiNic-453281866 tempest-ServersTestMultiNic-453281866-project-member] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 838.838999] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 838.839324] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.839488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.839586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.839794] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.839957] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.840504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.840630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.840836] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.840973] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.842081] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.849364] env[69499]: INFO networking_nsxv3.common.synchronization [req-618efbd1-41e4-4270-b71c-d8118fa7978f req-e663dd46-1b0f-43ea-aeca-1d91e9db1171 tempest-ImagesOneServerNegativeTestJSON-1949881093 tempest-ImagesOneServerNegativeTestJSON-1949881093-project-member] Enqueued Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 838.850285] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 838.850964] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.851157] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.851283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.851504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.851757] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.851912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.852023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.852219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.852354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.852597] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.934911] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.327730] env[69499]: INFO networking_nsxv3.common.synchronization [req-7ce24d74-25d3-4bf9-8c09-5dbbb8c2f58d req-e6586f0a-dd8b-4ffe-9f2d-cc2e6a8b72a7 tempest-ServersTestMultiNic-453281866 tempest-ServersTestMultiNic-453281866-project-member] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 839.328481] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 839.328912] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.329158] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.345411] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.345411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.345411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.345411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.355400] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.355516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.364034] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.364311] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.364462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.364550] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.364789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.364910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.365038] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be updated. [ 839.366049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.366303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.366424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.366680] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.366825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.366906] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.367101] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.367208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.367309] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 is going to be updated. [ 839.393057] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.393057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.393057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.393057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.393057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.395191] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.395365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.395432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.395677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.395758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.404187] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: IN_PROGRESS for 2s [ 839.404908] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 2s [ 839.437599] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.437773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.437844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.438056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.438149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.438332] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 is going to be updated. [ 839.470224] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.470224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.470224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.470224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.470458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.486821] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 in Status: IN_PROGRESS for 2s [ 839.680143] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-855 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.680355] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-855" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.680485] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-855" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.680829] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-855" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.681521] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.681699] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.681822] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.682244] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.682434] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.682653] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.682771] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.682882] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.682993] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.683118] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.683227] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.683371] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.701024] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.701203] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 839.701347] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.701529] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-855" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.701834] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-cf4451f8-99c6-409f-9ac1-b1fa582708c2 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.701999] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-cf4451f8-99c6-409f-9ac1-b1fa582708c2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.702205] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-cf4451f8-99c6-409f-9ac1-b1fa582708c2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.702501] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-cf4451f8-99c6-409f-9ac1-b1fa582708c2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.702765] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf4451f8-99c6-409f-9ac1-b1fa582708c2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.730134] env[69499]: INFO networking_nsxv3.common.synchronization [req-9ac9166a-08d6-48c8-b19e-d6df46361854 req-f647e64b-9431-43bc-9227-2c4315ed785e tempest-ServersAdminNegativeTestJSON-242497510 tempest-ServersAdminNegativeTestJSON-242497510-project-member] Enqueued Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_members [ 839.731037] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGHEST for action security_group_members [ 839.731037] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.731037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.731329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.731329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.731441] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.731540] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.731602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.731743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.731828] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.731917] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.209020] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.209020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.209020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.209020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.209020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.209020] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port cf4451f8-99c6-409f-9ac1-b1fa582708c2 not found, creating... [ 840.209020] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.209020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.209020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.209020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.209020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.210411] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.210905] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.211704] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.213676] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.214378] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.216242] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: cf4451f8-99c6-409f-9ac1-b1fa582708c2 is going to be created. [ 840.233901] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.234109] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.234197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.234501] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.234630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.234838] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.234937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.235023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.235227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.235334] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.235442] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f00aea48-dae0-47aa-a96c-f017c0721f54 is going to be updated. [ 840.253387] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.253620] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.253734] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.254067] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.254264] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.254493] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-cf4451f8-99c6-409f-9ac1-b1fa582708c2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.266228] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.267472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.267606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.267831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.268023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.278579] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: IN_PROGRESS for 2s [ 840.531226] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 in Status: SUCCESS [ 840.531226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.531226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.531226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.531226] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.994169] env[69499]: INFO networking_nsxv3.common.synchronization [req-7ce24d74-25d3-4bf9-8c09-5dbbb8c2f58d req-fa6ee282-7ad3-4dd0-b113-be1f587cbc26 service nova] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_rules [ 840.994420] env[69499]: INFO networking_nsxv3.common.synchronization [req-7ce24d74-25d3-4bf9-8c09-5dbbb8c2f58d req-fa6ee282-7ad3-4dd0-b113-be1f587cbc26 service nova] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 840.994583] env[69499]: INFO networking_nsxv3.common.synchronization [req-7ce24d74-25d3-4bf9-8c09-5dbbb8c2f58d req-fa6ee282-7ad3-4dd0-b113-be1f587cbc26 service nova] Enqueued Resource ID: cf4451f8-99c6-409f-9ac1-b1fa582708c2 with Priority: HIGHEST for action port [ 840.995134] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_rules [ 840.995297] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 840.995413] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf4451f8-99c6-409f-9ac1-b1fa582708c2 with Priority: HIGHEST for action port [ 840.995736] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.995882] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.996049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.997302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.997302] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.999541] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.999541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.999541] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf4451f8-99c6-409f-9ac1-b1fa582708c2 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.999541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf4451f8-99c6-409f-9ac1-b1fa582708c2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.999541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf4451f8-99c6-409f-9ac1-b1fa582708c2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.999541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf4451f8-99c6-409f-9ac1-b1fa582708c2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.999541] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf4451f8-99c6-409f-9ac1-b1fa582708c2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.033586] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-478dd7f8-67f8-49a4-9685-e070fbf463f1 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.033586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.415194] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 841.415541] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 deletion is rescheduled due to dependency. [ 841.415541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.415706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.416019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.416226] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.416348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.416431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.416588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.416670] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.416780] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.418260] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: SUCCESS [ 841.418444] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 deletion is rescheduled due to dependency. [ 841.418541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.457296] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f665134-f694-45cf-a5a1-87966e7eef4a req-e8ba897e-11ae-40e2-926d-527a19219036 tempest-VolumesAdminNegativeTest-1747404511 tempest-VolumesAdminNegativeTest-1747404511-project-member] Enqueued Resource ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 with Priority: HIGHEST for action security_group_members [ 841.457875] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 with Priority: HIGHEST for action security_group_members [ 841.458529] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.458657] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.458746] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.458972] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.459176] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.459298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.459362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.459521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.459627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.459737] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.494799] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 in Status: SUCCESS [ 841.495052] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.495205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.495538] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.495649] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.495739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.495841] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.495974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.496041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.496096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.496210] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.498929] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.499130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.501404] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf4451f8-99c6-409f-9ac1-b1fa582708c2 with status ACTIVE [ 841.502740] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.502740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.502740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.502740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.502740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.502740] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.502740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.502740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.502740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.502740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.502740] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.503241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.503241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.503241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.503241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.503241] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf4451f8-99c6-409f-9ac1-b1fa582708c2 is going to be updated. [ 841.521639] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.521826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.521876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.522130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.522284] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.522457] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf4451f8-99c6-409f-9ac1-b1fa582708c2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.881065] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-532 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.881313] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-532" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.881451] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-532" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.885022] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-532" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.885022] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.885022] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.885022] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.885022] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.885022] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.885022] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.885022] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.885022] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.885022] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.885022] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.885022] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.885022] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.904600] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.904842] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 841.904957] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.905274] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-532" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.905537] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-0ec353c5-eb71-41ec-8654-fe0a2096bf9a taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.905695] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-0ec353c5-eb71-41ec-8654-fe0a2096bf9a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.905813] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-0ec353c5-eb71-41ec-8654-fe0a2096bf9a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.906234] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-0ec353c5-eb71-41ec-8654-fe0a2096bf9a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.906392] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ec353c5-eb71-41ec-8654-fe0a2096bf9a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.919877] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.962185] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.962436] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.962603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.962875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.963061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.963384] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.963554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.963690] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.963939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.964088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.964259] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 is going to be updated. [ 841.991277] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.991448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.991519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.991760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.992123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.999042] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-478dd7f8-67f8-49a4-9685-e070fbf463f1 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.999223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.999374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.999685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.999866] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.999971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.000052] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.000724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.000724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.000724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.000724] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-478dd7f8-67f8-49a4-9685-e070fbf463f1 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.000724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.000724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.001103] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.001103] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.001103] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.001103] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.001264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.001302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.001414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.001472] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.008176] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 in Status: IN_PROGRESS for 2s [ 842.288569] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f00aea48-dae0-47aa-a96c-f017c0721f54 in Status: SUCCESS [ 842.288569] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f00aea48-dae0-47aa-a96c-f017c0721f54 deletion is rescheduled due to dependency. [ 842.288733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.411201] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.411476] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.411617] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.411856] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.412101] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.412297] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 0ec353c5-eb71-41ec-8654-fe0a2096bf9a not found, creating... [ 842.412573] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.412771] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.412964] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.413235] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.413395] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.413710] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.413898] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.414034] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.414663] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.414663] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.414800] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 0ec353c5-eb71-41ec-8654-fe0a2096bf9a is going to be created. [ 842.422425] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.433655] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.433834] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.433985] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.434664] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.434664] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.434784] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-0ec353c5-eb71-41ec-8654-fe0a2096bf9a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.508025] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 478dd7f8-67f8-49a4-9685-e070fbf463f1: rpc.has_security_group_logging(os_id): False [ 842.522712] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.522940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.522940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.523162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.523254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.523487] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.523589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.523647] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.523797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.523876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.524081] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.524173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.524233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.524375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.524451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.524630] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.524724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.524785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.524924] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.524998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.525599] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 is going to be updated. [ 842.618097] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.618097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.618097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.618300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.618448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.633628] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 in Status: IN_PROGRESS for 2s [ 842.691088] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f78a898-13e2-4e1d-ac12-f1e1968b2fed req-e0a63cdd-fbf2-4034-868d-3c99d272f67b tempest-ServersV294TestFqdnHostnames-1817828186 tempest-ServersV294TestFqdnHostnames-1817828186-project-member] Enqueued Resource ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d with Priority: HIGHEST for action security_group_members [ 842.691614] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d with Priority: HIGHEST for action security_group_members [ 842.693551] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-68bf910a-7d9f-4466-9028-7ab38c7fc30d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.693551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.693551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.693551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.693551] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.693551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.693551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.693551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.693551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.693551] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68bf910a-7d9f-4466-9028-7ab38c7fc30d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.926888] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.926888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.926888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.926888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.926888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.926888] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be updated. [ 842.968635] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.968956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.969187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.969613] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.970184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.978799] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 2s [ 843.196016] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.196362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.196486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.196749] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.196888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.197178] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.197362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.197420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.197588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.197668] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.197759] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d already deleted. [ 843.197839] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.201019] env[69499]: INFO networking_nsxv3.common.synchronization [req-7ce24d74-25d3-4bf9-8c09-5dbbb8c2f58d req-8440114b-1dc4-46cc-81fb-ea24698720f7 service nova] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_rules [ 843.201209] env[69499]: INFO networking_nsxv3.common.synchronization [req-7ce24d74-25d3-4bf9-8c09-5dbbb8c2f58d req-8440114b-1dc4-46cc-81fb-ea24698720f7 service nova] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 843.201464] env[69499]: INFO networking_nsxv3.common.synchronization [req-7ce24d74-25d3-4bf9-8c09-5dbbb8c2f58d req-8440114b-1dc4-46cc-81fb-ea24698720f7 service nova] Enqueued Resource ID: 0ec353c5-eb71-41ec-8654-fe0a2096bf9a with Priority: HIGHEST for action port [ 843.201576] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_rules [ 843.201700] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 843.202022] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ec353c5-eb71-41ec-8654-fe0a2096bf9a with Priority: HIGHEST for action port [ 843.202333] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.202427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.202663] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.202710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.202859] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ec353c5-eb71-41ec-8654-fe0a2096bf9a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.202943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ec353c5-eb71-41ec-8654-fe0a2096bf9a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.203077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ec353c5-eb71-41ec-8654-fe0a2096bf9a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.203440] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ec353c5-eb71-41ec-8654-fe0a2096bf9a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.203566] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ec353c5-eb71-41ec-8654-fe0a2096bf9a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.253688] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.253688] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-842" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.253688] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-842" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.253688] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-842" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.254121] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.256429] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.256577] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.256813] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.257028] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.257256] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.257305] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.257418] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.257527] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.257638] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.257745] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.257878] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.275523] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.275696] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 843.275839] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.276057] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-842" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.276388] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-c8c6b614-efc2-4881-996a-8f54c6f222d1 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.276560] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-c8c6b614-efc2-4881-996a-8f54c6f222d1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.276682] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-c8c6b614-efc2-4881-996a-8f54c6f222d1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.277012] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-c8c6b614-efc2-4881-996a-8f54c6f222d1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.277154] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8c6b614-efc2-4881-996a-8f54c6f222d1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.362692] env[69499]: INFO networking_nsxv3.common.synchronization [req-ecdff21e-7a52-4139-ab8e-e8c322e8b03f req-43701575-46b2-44c9-ac29-7237a5b5c0d4 tempest-ServersAdminTestJSON-2112223204 tempest-ServersAdminTestJSON-2112223204-project-member] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 843.363230] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 843.363555] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.363715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.363788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.363989] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.364268] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.364372] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.364430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.364586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.364667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.364765] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.706057] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ec353c5-eb71-41ec-8654-fe0a2096bf9a with status ACTIVE [ 843.706368] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.706368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.706368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.706555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.706622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.706802] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.706903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.706960] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.707132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.707210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.707392] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.707490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.707542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.707672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.707746] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.707808] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ec353c5-eb71-41ec-8654-fe0a2096bf9a is going to be updated. [ 843.726617] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.726697] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.726697] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.727312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.727312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.727312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ec353c5-eb71-41ec-8654-fe0a2096bf9a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.779564] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.779740] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.779870] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.780189] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.780345] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.780651] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port c8c6b614-efc2-4881-996a-8f54c6f222d1 not found, creating... [ 843.780790] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.780912] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.781048] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.781274] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.781411] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.781698] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.781886] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.781960] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.782189] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.782352] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.782535] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: c8c6b614-efc2-4881-996a-8f54c6f222d1 is going to be created. [ 843.801291] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.801500] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.801610] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.801852] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.802093] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.802307] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-c8c6b614-efc2-4881-996a-8f54c6f222d1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.877709] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.018298] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 in Status: SUCCESS [ 844.019208] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 deletion is rescheduled due to dependency. [ 844.019208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.375987] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.523522] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f78a898-13e2-4e1d-ac12-f1e1968b2fed req-78300450-498d-46d1-8522-20243b85e487 service nova] Enqueued Resource ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d with Priority: HIGHEST for action security_group_rules [ 844.523727] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f78a898-13e2-4e1d-ac12-f1e1968b2fed req-78300450-498d-46d1-8522-20243b85e487 service nova] Enqueued Resource ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d with Priority: HIGHEST for action security_group_members [ 844.523956] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f78a898-13e2-4e1d-ac12-f1e1968b2fed req-78300450-498d-46d1-8522-20243b85e487 service nova] Enqueued Resource ID: c8c6b614-efc2-4881-996a-8f54c6f222d1 with Priority: HIGHEST for action port [ 844.524637] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d with Priority: HIGHEST for action security_group_rules [ 844.524762] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d with Priority: HIGHEST for action security_group_members [ 844.524854] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8c6b614-efc2-4881-996a-8f54c6f222d1 with Priority: HIGHEST for action port [ 844.526395] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.526395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.526395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.526395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.526395] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68bf910a-7d9f-4466-9028-7ab38c7fc30d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.529031] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-68bf910a-7d9f-4466-9028-7ab38c7fc30d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.529031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.529031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.529031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.529031] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.529031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.529031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.529031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.529031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.529031] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68bf910a-7d9f-4466-9028-7ab38c7fc30d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.530344] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8c6b614-efc2-4881-996a-8f54c6f222d1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.530344] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8c6b614-efc2-4881-996a-8f54c6f222d1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.530344] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8c6b614-efc2-4881-996a-8f54c6f222d1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.530344] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8c6b614-efc2-4881-996a-8f54c6f222d1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.530344] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8c6b614-efc2-4881-996a-8f54c6f222d1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.645355] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 in Status: SUCCESS [ 844.645765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.878465] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.878843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.878843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.879140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.879273] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.879563] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be updated. [ 844.904742] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.904926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.904999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.905221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.905394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.913902] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 844.987844] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 844.988091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.988334] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.988556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.988747] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.988865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.988932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.989097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.989177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.989331] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.032370] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68bf910a-7d9f-4466-9028-7ab38c7fc30d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.033719] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-68bf910a-7d9f-4466-9028-7ab38c7fc30d taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.033719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.033719] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8c6b614-efc2-4881-996a-8f54c6f222d1 with status ACTIVE [ 845.033958] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.034105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.034173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.037537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.037537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.037537] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.037537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.037537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.037537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.037537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.037537] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.037537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.037537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.037537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.037537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.037537] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8c6b614-efc2-4881-996a-8f54c6f222d1 is going to be updated. [ 845.055475] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.056564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.056564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.056564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.056564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.056564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8c6b614-efc2-4881-996a-8f54c6f222d1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.491691] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.538314] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68bf910a-7d9f-4466-9028-7ab38c7fc30d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.993441] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.041111] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.041295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.041371] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.041595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.041686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.041788] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d is going to be created. [ 846.064986] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.065179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.065260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.065512] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.065730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.073821] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d in Status: UNINITIALIZED for 2s [ 846.496109] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.496286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.496391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.496591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.496683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.496847] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be updated. [ 846.521134] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.521304] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.521378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.521637] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.521813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.530249] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 2s [ 846.923459] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 846.923706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.084357] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d in Status: SUCCESS [ 848.087041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.087041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.087041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.087041] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.087041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.087041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.087041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.087041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.087041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.087041] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68bf910a-7d9f-4466-9028-7ab38c7fc30d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.540532] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 848.540795] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.540965] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.541197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.541387] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.541505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.541570] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.541722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.541801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.541887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.542022] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.542878] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.543210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.543210] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.543310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.543396] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.543592] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.543694] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.543815] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.589340] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68bf910a-7d9f-4466-9028-7ab38c7fc30d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.045597] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.046286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.046394] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.091702] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68bf910a-7d9f-4466-9028-7ab38c7fc30d: rpc.has_security_group_logging(os_id): False [ 849.110184] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.110316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.110380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.110609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.110724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.110989] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.111115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.111180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.111382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.111465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.111568] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d is going to be created. [ 849.167084] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.167177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.167242] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.167483] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.167680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.178924] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d in Status: IN_PROGRESS for 2s [ 849.526192] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 849.526326] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 849.551135] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.865208] env[69499]: INFO networking_nsxv3.common.synchronization [req-a13d55d5-cbd5-4c84-9d40-398bebae6b97 req-aef0789a-f32d-434b-86e5-61a1eb57101b tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_members [ 849.865766] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_members [ 849.867182] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b93818-38bc-46b2-af63-51d39fce766c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.867345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.867420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.867650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.867828] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.867945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.867996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.868154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.868238] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.868357] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.057747] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.057747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.057747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.057747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.057747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.057747] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be updated. [ 850.087775] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.087948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.088039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.088908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.088908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.102493] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 2s [ 850.374025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.374025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.374025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.374025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.374025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.374025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.374025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.374025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.374025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.374025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.374025] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2b93818-38bc-46b2-af63-51d39fce766c is going to be updated. [ 850.400715] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.400842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.400957] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.401338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.401575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.411877] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2b93818-38bc-46b2-af63-51d39fce766c in Status: IN_PROGRESS for 2s [ 851.198438] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d in Status: SUCCESS [ 851.199560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.110588] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 4s [ 852.424798] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2b93818-38bc-46b2-af63-51d39fce766c in Status: SUCCESS [ 852.425050] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2b93818-38bc-46b2-af63-51d39fce766c deletion is rescheduled due to dependency. [ 852.425176] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.122390] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 854.125025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.125025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.125025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.125025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.125025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.125025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.125025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.125025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.125025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.125025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.125025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.125025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.125025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.125753] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.125963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.126181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.126425] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.126764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.127045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.127242] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.630903] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb18857e-504d-46d0-8833-741cccaef5b3: rpc.has_security_group_logging(os_id): False [ 854.649775] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.649920] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.649995] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.650237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.650376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.650517] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.650618] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.650679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.650827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.650903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.651112] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.653392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.653392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.653392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.653392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.653392] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.653392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.653392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.653392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.653392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.653392] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be updated. [ 854.710644] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.712310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.712310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.712310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.712310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.726373] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 2s [ 854.868554] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 854.871166] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 855.118449] env[69499]: INFO networking_nsxv3.common.synchronization [req-c76d4bb8-e9b2-42c4-91b6-87f634c944c2 req-4edd9187-7a1a-4af0-a987-817e4d2c6c7b tempest-AttachVolumeTestJSON-2079313698 tempest-AttachVolumeTestJSON-2079313698-project-member] Enqueued Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGHEST for action security_group_members [ 855.119054] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGHEST for action security_group_members [ 855.124225] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1159257b-8ed6-4ac4-9971-8ad543ef43f9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.124225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.124225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.124225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.124225] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.124225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.124225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.124225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.124225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.124748] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1159257b-8ed6-4ac4-9971-8ad543ef43f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.627908] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.628114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.628189] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.628549] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.628655] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.629265] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.629265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.629265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.629265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.629265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.629515] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 is going to be updated. [ 855.654598] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.654747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.654820] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.655032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.655173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.663420] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 in Status: IN_PROGRESS for 2s [ 855.992032] env[69499]: INFO networking_nsxv3.common.synchronization [req-a8d48577-c7ba-4310-9aaf-69577bf0b138 req-4635d9da-685f-4cb9-a0b5-0ad8ea02ef30 tempest-ServersTestMultiNic-453281866 tempest-ServersTestMultiNic-453281866-project-member] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 855.992631] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 855.993787] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.993787] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.993787] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.993787] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.993787] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.994282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.994282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.994282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.994282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.994282] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.498180] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.695317] env[69499]: INFO networking_nsxv3.common.synchronization [req-a8d48577-c7ba-4310-9aaf-69577bf0b138 req-2957a16b-4388-49e4-bc41-8069529c80d5 tempest-ServersTestMultiNic-453281866 tempest-ServersTestMultiNic-453281866-project-member] Enqueued Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 856.696295] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb18857e-504d-46d0-8833-741cccaef5b3 with Priority: HIGHEST for action security_group_members [ 856.697816] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb18857e-504d-46d0-8833-741cccaef5b3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.697816] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.742054] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 856.742452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.743130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.743453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.743590] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.000894] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.264925] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.265090] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.265150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.265371] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.265462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.265562] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be deleted. [ 857.311025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.311109] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.311139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.311710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.311797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.311914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.504028] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.504028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.504028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.504408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.504408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.504481] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be updated. [ 857.532288] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.532288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.532288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.532455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.532455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.543498] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: IN_PROGRESS for 2s [ 857.677024] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 in Status: SUCCESS [ 857.677024] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 deletion is rescheduled due to dependency. [ 857.677024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.093965] env[69499]: INFO networking_nsxv3.common.synchronization [req-9d830c0f-0aaa-453f-8824-b2ed634375b3 req-aafa14c9-565b-4aa1-bf0b-e6c590640563 tempest-ServerDiskConfigTestJSON-146039362 tempest-ServerDiskConfigTestJSON-146039362-project-member] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 859.094634] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 859.094980] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.095299] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.095374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.095607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.095824] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.095886] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.095958] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.096145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.096252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.096373] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.550341] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.550570] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.550716] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.551077] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.551716] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.551900] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.552040] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.552279] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.552433] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.552673] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.552792] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.552909] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.553035] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.553152] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.553264] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.553423] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.555261] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb18857e-504d-46d0-8833-741cccaef5b3 in Status: SUCCESS [ 859.555484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.556046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.556269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.556484] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.556594] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.556661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.556818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.556899] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.556994] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb18857e-504d-46d0-8833-741cccaef5b3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.573470] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.573683] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 859.573829] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.574024] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.574432] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-602fb7e0-c587-4570-8201-7a564c049e7b taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.574557] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-602fb7e0-c587-4570-8201-7a564c049e7b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.574655] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-602fb7e0-c587-4570-8201-7a564c049e7b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.575071] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-602fb7e0-c587-4570-8201-7a564c049e7b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.575223] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('602fb7e0-c587-4570-8201-7a564c049e7b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.598426] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.598586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.598663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.598922] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.599037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.599232] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.599327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.599391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.599550] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.599617] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.599733] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be deleted. [ 859.626552] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.626731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.626799] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.627066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.627184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.627316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.060345] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.060569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.060677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.060934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.061091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.061275] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.061568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.061568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.061701] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.061796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.061891] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb18857e-504d-46d0-8833-741cccaef5b3 is going to be deleted. [ 860.078128] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.078422] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.078580] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.078792] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.078948] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.079505] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 602fb7e0-c587-4570-8201-7a564c049e7b not found, creating... [ 860.079505] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.079679] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.081049] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.081049] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.081049] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.081049] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.081049] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.081049] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.081049] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.081049] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.081398] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 602fb7e0-c587-4570-8201-7a564c049e7b is going to be created. [ 860.092161] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.092303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.092378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.092553] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.092644] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.092741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb18857e-504d-46d0-8833-741cccaef5b3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.099033] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.099350] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.099350] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.099688] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.100712] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.100712] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-602fb7e0-c587-4570-8201-7a564c049e7b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.889523] env[69499]: INFO networking_nsxv3.common.synchronization [req-9d830c0f-0aaa-453f-8824-b2ed634375b3 req-bfd87c08-be63-46e2-ab55-4703a898c123 service nova] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_rules [ 860.889523] env[69499]: INFO networking_nsxv3.common.synchronization [req-9d830c0f-0aaa-453f-8824-b2ed634375b3 req-bfd87c08-be63-46e2-ab55-4703a898c123 service nova] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 860.889523] env[69499]: INFO networking_nsxv3.common.synchronization [req-9d830c0f-0aaa-453f-8824-b2ed634375b3 req-bfd87c08-be63-46e2-ab55-4703a898c123 service nova] Enqueued Resource ID: 602fb7e0-c587-4570-8201-7a564c049e7b with Priority: HIGHEST for action port [ 860.889708] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_rules [ 860.889808] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 860.889902] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 602fb7e0-c587-4570-8201-7a564c049e7b with Priority: HIGHEST for action port [ 860.890609] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.890812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.890929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.891230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.891352] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.892232] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.892663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.892663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.892663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.892871] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.893424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.893626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.893758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.893875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.894015] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.894852] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-602fb7e0-c587-4570-8201-7a564c049e7b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.894935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-602fb7e0-c587-4570-8201-7a564c049e7b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.895078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-602fb7e0-c587-4570-8201-7a564c049e7b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.895162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-602fb7e0-c587-4570-8201-7a564c049e7b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.895281] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('602fb7e0-c587-4570-8201-7a564c049e7b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.397295] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.397612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.397673] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.398599] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 602fb7e0-c587-4570-8201-7a564c049e7b with status ACTIVE [ 861.398798] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.398911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.398978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.399201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.399290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.399460] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.399554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.399615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.399786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.399863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.400051] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.400144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.400205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.400365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.400411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.400557] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 602fb7e0-c587-4570-8201-7a564c049e7b is going to be updated. [ 861.419374] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.419507] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.419614] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.419793] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.419896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.420059] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-602fb7e0-c587-4570-8201-7a564c049e7b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.902894] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.405960] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.406279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.406279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.406560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.406663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.406768] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be created. [ 862.430041] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.430041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.430041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.430041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.430041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.439516] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: UNINITIALIZED for 2s [ 863.133622] env[69499]: INFO networking_nsxv3.common.synchronization [None req-6fbc5e66-3936-47ef-af3b-239183e1666a tempest-ServerActionsTestJSON-629709431 tempest-ServerActionsTestJSON-629709431-project-member] Enqueued Resource ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea with Priority: HIGHEST for action security_group_rules [ 863.134859] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea with Priority: HIGHEST for action security_group_rules [ 863.134859] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.134859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.135055] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.135331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.135424] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.653119] env[69499]: INFO networking_nsxv3.common.synchronization [None req-a77efc26-9ec6-4236-9acf-a399f9d49e4d tempest-ServerActionsTestJSON-629709431 tempest-ServerActionsTestJSON-629709431-project-member] Enqueued Resource ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea with Priority: HIGHEST for action security_group_rules [ 863.655033] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.655033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.655033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.655033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.655033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.655309] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea already deleted. [ 863.655309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.655657] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea with Priority: HIGHEST for action security_group_rules [ 863.655969] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.656084] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.656152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.656311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.656410] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.175500] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.175743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.175851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.176224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.176500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.176583] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea already deleted. [ 864.176695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.452853] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 864.452853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.452853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.452853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.452853] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.452853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.452853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.452853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.452853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.452853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.452853] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.816841] env[69499]: INFO networking_nsxv3.common.synchronization [req-ebb731ce-438a-49c6-b805-e5b62db3e64d req-2be4e7ec-ff94-4082-b82a-932e08fbe2f6 tempest-ServerAddressesNegativeTestJSON-1386963904 tempest-ServerAddressesNegativeTestJSON-1386963904-project-member] Enqueued Resource ID: ed300e57-2eef-458b-9bd5-cd62d0872060 with Priority: HIGHEST for action security_group_members [ 864.817519] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed300e57-2eef-458b-9bd5-cd62d0872060 with Priority: HIGHEST for action security_group_members [ 864.817894] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed300e57-2eef-458b-9bd5-cd62d0872060 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.818042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.818149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.818441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.818650] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.818761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.818827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.819031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.819278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.819422] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed300e57-2eef-458b-9bd5-cd62d0872060',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.953651] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.953847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.953920] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.954197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.954374] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.954504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.954578] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.954742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.954850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.954941] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.955118] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.955226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.955335] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.955590] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.955749] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.955850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.955927] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.956099] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.956180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.956267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.956490] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.283687] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.284083] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-644" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.284234] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-644" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.284591] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-644" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.284909] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.285174] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.285336] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.285651] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.285767] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.286081] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.286142] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.286341] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.286467] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.286623] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.286769] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.286917] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.308020] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.308257] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 865.308426] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.308636] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-644" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.308968] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-086f4100-dacd-476c-83c8-865abf910212 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.309164] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-086f4100-dacd-476c-83c8-865abf910212" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.309295] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-086f4100-dacd-476c-83c8-865abf910212" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.309688] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-086f4100-dacd-476c-83c8-865abf910212" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.309813] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('086f4100-dacd-476c-83c8-865abf910212',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.324784] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.325265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.325265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.325970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.325970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.325970] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.325970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.325970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.326181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.326181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.326237] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed300e57-2eef-458b-9bd5-cd62d0872060 already deleted. [ 865.326324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.458750] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31a7bec7-75f3-4780-ac90-0f2f7e7744e9: rpc.has_security_group_logging(os_id): False [ 865.475222] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.475431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.475485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.475673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.475763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.475974] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.476099] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.476157] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.476298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.476367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.476557] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.476652] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.476702] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.476842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.476912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.477103] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.477207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.477289] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.477429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.477489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.477576] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be created. [ 865.533495] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.533495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.533655] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.533717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.533896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.545595] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 865.812904] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.813153] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.813283] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.813575] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.813730] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.813896] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 086f4100-dacd-476c-83c8-865abf910212 not found, creating... [ 865.814154] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.814317] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.814438] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.814667] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.814867] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.815167] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.815326] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.815443] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.815657] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.815793] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.815931] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 086f4100-dacd-476c-83c8-865abf910212 is going to be created. [ 865.834557] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.834854] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.834893] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.835141] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.835366] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.835578] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-086f4100-dacd-476c-83c8-865abf910212" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.680324] env[69499]: INFO networking_nsxv3.common.synchronization [req-ebb731ce-438a-49c6-b805-e5b62db3e64d req-b2f0dbf7-222e-4eb9-bf3b-352218687901 service nova] Enqueued Resource ID: ed300e57-2eef-458b-9bd5-cd62d0872060 with Priority: HIGHEST for action security_group_rules [ 866.680542] env[69499]: INFO networking_nsxv3.common.synchronization [req-ebb731ce-438a-49c6-b805-e5b62db3e64d req-b2f0dbf7-222e-4eb9-bf3b-352218687901 service nova] Enqueued Resource ID: ed300e57-2eef-458b-9bd5-cd62d0872060 with Priority: HIGHEST for action security_group_members [ 866.680705] env[69499]: INFO networking_nsxv3.common.synchronization [req-ebb731ce-438a-49c6-b805-e5b62db3e64d req-b2f0dbf7-222e-4eb9-bf3b-352218687901 service nova] Enqueued Resource ID: 086f4100-dacd-476c-83c8-865abf910212 with Priority: HIGHEST for action port [ 866.680939] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed300e57-2eef-458b-9bd5-cd62d0872060 with Priority: HIGHEST for action security_group_rules [ 866.685332] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed300e57-2eef-458b-9bd5-cd62d0872060 with Priority: HIGHEST for action security_group_members [ 866.685332] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086f4100-dacd-476c-83c8-865abf910212 with Priority: HIGHEST for action port [ 866.685332] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed300e57-2eef-458b-9bd5-cd62d0872060 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.685332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.685332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.685332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.685332] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed300e57-2eef-458b-9bd5-cd62d0872060',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.685332] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed300e57-2eef-458b-9bd5-cd62d0872060 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.685332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.685805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.685805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.685805] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.685805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.685940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.686016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.686827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.686929] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed300e57-2eef-458b-9bd5-cd62d0872060',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.687734] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-086f4100-dacd-476c-83c8-865abf910212 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.687844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-086f4100-dacd-476c-83c8-865abf910212" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.687910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-086f4100-dacd-476c-83c8-865abf910212" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.688078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-086f4100-dacd-476c-83c8-865abf910212" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.688153] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('086f4100-dacd-476c-83c8-865abf910212',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.190250] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed300e57-2eef-458b-9bd5-cd62d0872060',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.191323] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed300e57-2eef-458b-9bd5-cd62d0872060 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.191466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.191626] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 086f4100-dacd-476c-83c8-865abf910212 with status ACTIVE [ 867.191791] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.191899] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.191964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.192174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.192259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.192425] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.192523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.192584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.192732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.192839] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.192980] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.193087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.193147] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.193285] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.193357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.193437] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 086f4100-dacd-476c-83c8-865abf910212 is going to be updated. [ 867.213090] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.213240] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.213291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.213477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.213603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.213747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-086f4100-dacd-476c-83c8-865abf910212" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.245366] env[69499]: INFO networking_nsxv3.common.synchronization [req-42f54a8c-c71c-410a-ae73-2d4ba58746ad req-471b77b5-044c-45c1-9607-e6ec08eb665a tempest-ImagesTestJSON-490670806 tempest-ImagesTestJSON-490670806-project-member] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 867.245908] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 867.246633] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.246771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.246834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.247048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.247207] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.247303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.247365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.247519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.247603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.247694] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.557191] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 867.557441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.643493] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.643686] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.643750] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.644074] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.644366] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.644546] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.644686] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.644925] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.645093] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.645337] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.645456] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.645581] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.645702] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.645816] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.645979] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.646089] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.664430] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.664590] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 867.664731] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.664911] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.665243] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-b505d13f-b894-4351-a8f3-df9f138e9199 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.665418] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-b505d13f-b894-4351-a8f3-df9f138e9199" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.665544] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-b505d13f-b894-4351-a8f3-df9f138e9199" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.665864] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-b505d13f-b894-4351-a8f3-df9f138e9199" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.666015] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b505d13f-b894-4351-a8f3-df9f138e9199',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.696628] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed300e57-2eef-458b-9bd5-cd62d0872060',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.749931] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.168936] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.169191] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.169374] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.169655] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.169854] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.169979] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port b505d13f-b894-4351-a8f3-df9f138e9199 not found, creating... [ 868.170258] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.170421] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.170552] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.170830] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.170981] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.171326] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.171447] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.171556] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.171755] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.171891] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.172042] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: b505d13f-b894-4351-a8f3-df9f138e9199 is going to be created. [ 868.193094] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.193698] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.193698] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.193919] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.194232] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.194522] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-b505d13f-b894-4351-a8f3-df9f138e9199" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.198348] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.198613] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.198706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.198917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.199015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.199107] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed300e57-2eef-458b-9bd5-cd62d0872060 is going to be created. [ 868.223233] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.223391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.223465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.223684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.223843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.234055] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed300e57-2eef-458b-9bd5-cd62d0872060 in Status: UNINITIALIZED for 2s [ 868.251551] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.754535] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.754698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.754759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.758362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.758490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.758588] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 868.785557] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.785651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.785651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.787984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.788174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.804724] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 868.955103] env[69499]: INFO networking_nsxv3.common.synchronization [req-42f54a8c-c71c-410a-ae73-2d4ba58746ad req-faff6bed-11dd-47d8-82e4-27318c6280b5 service nova] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_rules [ 868.955680] env[69499]: INFO networking_nsxv3.common.synchronization [req-42f54a8c-c71c-410a-ae73-2d4ba58746ad req-faff6bed-11dd-47d8-82e4-27318c6280b5 service nova] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 868.956228] env[69499]: INFO networking_nsxv3.common.synchronization [req-42f54a8c-c71c-410a-ae73-2d4ba58746ad req-faff6bed-11dd-47d8-82e4-27318c6280b5 service nova] Enqueued Resource ID: b505d13f-b894-4351-a8f3-df9f138e9199 with Priority: HIGHEST for action port [ 868.956885] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_rules [ 868.957073] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 868.957551] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b505d13f-b894-4351-a8f3-df9f138e9199 with Priority: HIGHEST for action port [ 868.958205] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.958347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.958562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.958761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.958879] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.960499] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.962687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.962687] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-b505d13f-b894-4351-a8f3-df9f138e9199 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.962687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b505d13f-b894-4351-a8f3-df9f138e9199" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.962687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b505d13f-b894-4351-a8f3-df9f138e9199" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.962687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b505d13f-b894-4351-a8f3-df9f138e9199" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.962687] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b505d13f-b894-4351-a8f3-df9f138e9199',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.463725] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.464045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.465214] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b505d13f-b894-4351-a8f3-df9f138e9199 with status ACTIVE [ 869.465409] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.465532] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.465597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.465815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.465906] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.466146] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.466352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.466469] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.466640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.466723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.466907] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.467076] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.467169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.467341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.467444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.467550] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b505d13f-b894-4351-a8f3-df9f138e9199 is going to be updated. [ 869.486338] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.486494] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.486571] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.486742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.487146] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.487146] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b505d13f-b894-4351-a8f3-df9f138e9199" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.244050] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed300e57-2eef-458b-9bd5-cd62d0872060 in Status: SUCCESS [ 870.244050] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.244207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.244414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.244604] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.244723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.244790] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.244943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.245034] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.245120] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.245209] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed300e57-2eef-458b-9bd5-cd62d0872060',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.750748] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed300e57-2eef-458b-9bd5-cd62d0872060 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.750748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.750748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.750748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.750748] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.750748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.750748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.750748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.750748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.750748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.750748] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed300e57-2eef-458b-9bd5-cd62d0872060 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.750748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.750748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.750748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.750748] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.750748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.751634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.751634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.751634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.751634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.751634] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed300e57-2eef-458b-9bd5-cd62d0872060',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.817300] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 870.818026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.818026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.818026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.818161] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.818262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.818321] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.818551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.818632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.818727] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.875166] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-490 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.875359] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.875494] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.876041] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.877350] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.877350] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.877350] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.877350] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.877350] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.877526] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.877743] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.877743] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.877851] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.877961] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.878084] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.878222] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.897032] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.897032] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 870.897032] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.897193] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.897500] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-25575976-0a88-43e5-ad3c-f04c3e76efc6 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.897681] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.897798] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.898081] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.898226] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25575976-0a88-43e5-ad3c-f04c3e76efc6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.252901] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed300e57-2eef-458b-9bd5-cd62d0872060: rpc.has_security_group_logging(os_id): False [ 871.270149] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.270149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.270149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.270756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.270756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.270756] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.270756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.270756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.270993] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.270993] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.271118] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.271208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.271259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.271400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.271474] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.271732] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.271837] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.271892] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.272042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.272117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.272202] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed300e57-2eef-458b-9bd5-cd62d0872060 is going to be created. [ 871.321016] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.326257] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.326257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.326257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.326257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.326257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.335836] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed300e57-2eef-458b-9bd5-cd62d0872060 in Status: IN_PROGRESS for 2s [ 871.401751] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.402025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.402202] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.402543] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.402739] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.403127] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.403338] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.403492] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.403749] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.403928] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.406045] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.406261] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.406683] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.406932] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.406979] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.407257] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 25575976-0a88-43e5-ad3c-f04c3e76efc6 is going to be updated. [ 871.435659] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.435659] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.435659] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.435659] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.435659] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.435659] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.825446] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.329035] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.329035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.329035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.329035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.329035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.329035] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 872.338953] env[69499]: INFO networking_nsxv3.common.synchronization [req-83acd511-0b5a-4395-a0e3-c92e938f3b9c req-97937716-2ecf-46ba-b97a-860ef32b2024 service nova] Enqueued Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_rules [ 872.339182] env[69499]: INFO networking_nsxv3.common.synchronization [req-83acd511-0b5a-4395-a0e3-c92e938f3b9c req-97937716-2ecf-46ba-b97a-860ef32b2024 service nova] Enqueued Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_members [ 872.339266] env[69499]: INFO networking_nsxv3.common.synchronization [req-83acd511-0b5a-4395-a0e3-c92e938f3b9c req-97937716-2ecf-46ba-b97a-860ef32b2024 service nova] Enqueued Resource ID: 25575976-0a88-43e5-ad3c-f04c3e76efc6 with Priority: HIGHEST for action port [ 872.339510] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_rules [ 872.339637] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_members [ 872.339737] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25575976-0a88-43e5-ad3c-f04c3e76efc6 with Priority: HIGHEST for action port [ 872.340343] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8593ab1f-869e-4abc-aa58-bb57de585b7e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.340487] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.341031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.341317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.341404] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.342705] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8593ab1f-869e-4abc-aa58-bb57de585b7e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.342932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.342932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.343083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.343287] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.343394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.343477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.343666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.343756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.343867] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.345211] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-25575976-0a88-43e5-ad3c-f04c3e76efc6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.345211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.345211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.345369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.345477] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25575976-0a88-43e5-ad3c-f04c3e76efc6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.355323] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.355323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.355323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.355323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.355535] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.364220] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 872.847581] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25575976-0a88-43e5-ad3c-f04c3e76efc6 with status ACTIVE [ 872.847845] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.847967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.848217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.848578] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.848686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.848879] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.848988] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.849067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.849232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.849310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.849500] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.849584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.849684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.849788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.849858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.849944] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25575976-0a88-43e5-ad3c-f04c3e76efc6 is going to be updated. [ 872.851136] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.852111] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8593ab1f-869e-4abc-aa58-bb57de585b7e taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.852234] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.873756] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.873756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.873756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.874351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.874616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.875095] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25575976-0a88-43e5-ad3c-f04c3e76efc6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.353213] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed300e57-2eef-458b-9bd5-cd62d0872060 in Status: SUCCESS [ 873.353292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.355703] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.462889] env[69499]: INFO networking_nsxv3.common.synchronization [None req-29b8716b-ceb3-4dd1-9c65-54fdd3296bd8 tempest-ServerRescueNegativeTestJSON-106874270 tempest-ServerRescueNegativeTestJSON-106874270-project-member] Enqueued Resource ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce with Priority: HIGHEST for action security_group_rules [ 873.465769] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce with Priority: HIGHEST for action security_group_rules [ 873.465769] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.465769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.465769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.465769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.465769] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b43d2067-f3a1-4ba4-a448-6e853d1bb2ce',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.544064] env[69499]: INFO networking_nsxv3.common.synchronization [None req-87dd5c0a-67c8-4b6b-a02e-8438a5d0e5cd tempest-ServerRescueNegativeTestJSON-106874270 tempest-ServerRescueNegativeTestJSON-106874270-project-member] Enqueued Resource ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce with Priority: HIGHEST for action security_group_rules [ 873.545134] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce with Priority: HIGHEST for action security_group_rules [ 873.547188] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.547327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.858251] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.858621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.858621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.858848] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.859022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.859211] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e is going to be updated. [ 873.885621] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.885909] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.885909] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.886075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.886222] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.896184] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e in Status: IN_PROGRESS for 2s [ 873.985363] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.985363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.985363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.985363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.985363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.985363] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce already deleted. [ 873.985363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.985363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.985363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.985363] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b43d2067-f3a1-4ba4-a448-6e853d1bb2ce',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.373960] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 874.375680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.375680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.375680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.375680] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.375680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.375680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.375680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.375680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.375680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.375680] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.504355] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.504355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.504355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.504355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.504355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.504355] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce already deleted. [ 874.504355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.883203] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.883203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.883203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.883203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.883203] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.883203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.883203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.883203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.883203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.883203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.883203] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.883203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.883203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.883203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.883203] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.883203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.884300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.884300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.884300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.884300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.884300] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.386185] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 137495f6-8f3c-475d-b71c-88971c3781de: rpc.has_security_group_logging(os_id): False [ 875.404450] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.404590] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.404662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.404878] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.404968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.405288] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.405288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.405416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.405507] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.405584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.405767] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.405860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.405921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.406097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.406181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.406345] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.406434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.406491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.406628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.406695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.406786] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 875.464142] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.464142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.464142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.464142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.464142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.474242] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 875.907815] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e in Status: SUCCESS [ 875.908110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.909166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.909166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.909166] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.909166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.909166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.909166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.909166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.909441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.909441] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.413050] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.561196] env[69499]: INFO networking_nsxv3.common.synchronization [req-b6d7b9f7-3df4-4720-bfd5-70de91f3abc0 req-251b741f-971e-4814-8df9-558919870d17 tempest-ListServerFiltersTestJSON-1505479587 tempest-ListServerFiltersTestJSON-1505479587-project-member] Enqueued Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 876.561196] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 876.561196] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.561196] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.561196] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.561196] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.567421] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.567421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.567421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.567421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.567421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.567421] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.917735] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8593ab1f-869e-4abc-aa58-bb57de585b7e: rpc.has_security_group_logging(os_id): False [ 876.936838] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.937054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.937212] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.938388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.938388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.938388] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.938388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.938388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.938388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.938388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.938388] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e is going to be created. [ 877.000295] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.000445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.000524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.000796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.000964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.015668] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e in Status: IN_PROGRESS for 2s [ 877.067701] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.067958] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.068065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.069347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.069347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.069347] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.069347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.069347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.069347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.069347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.069813] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 already deleted. [ 877.069813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.207198] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-261 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.207198] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-261" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.207198] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-261" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.207198] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-261" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.207198] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.207198] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.207198] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.208145] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.208492] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.208834] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 877.209188] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 877.209424] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 877.209643] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 877.209849] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 877.210190] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 877.210464] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 877.237021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 877.237021] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 877.237021] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 877.237021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-261" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.237021] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-aa62d620-3698-4ee3-b4b9-f3aaf937876a taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.237021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-aa62d620-3698-4ee3-b4b9-f3aaf937876a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.237021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-aa62d620-3698-4ee3-b4b9-f3aaf937876a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.237021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-aa62d620-3698-4ee3-b4b9-f3aaf937876a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.237865] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa62d620-3698-4ee3-b4b9-f3aaf937876a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.489016] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 877.489016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.741962] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.742357] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.742490] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.742829] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.743041] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.743187] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port aa62d620-3698-4ee3-b4b9-f3aaf937876a not found, creating... [ 877.743548] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.743731] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.743856] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.744454] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.749310] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.749310] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.749310] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.749310] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.749310] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.749310] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.749310] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: aa62d620-3698-4ee3-b4b9-f3aaf937876a is going to be created. [ 877.778751] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.779062] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.781120] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.781506] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.781821] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.782368] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-aa62d620-3698-4ee3-b4b9-f3aaf937876a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.798493] env[69499]: INFO networking_nsxv3.common.synchronization [req-b6d7b9f7-3df4-4720-bfd5-70de91f3abc0 req-73bd24d6-d558-4cd0-9e7d-e23cbc8da87e service nova] Enqueued Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_rules [ 878.798834] env[69499]: INFO networking_nsxv3.common.synchronization [req-b6d7b9f7-3df4-4720-bfd5-70de91f3abc0 req-73bd24d6-d558-4cd0-9e7d-e23cbc8da87e service nova] Enqueued Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 878.798977] env[69499]: INFO networking_nsxv3.common.synchronization [req-b6d7b9f7-3df4-4720-bfd5-70de91f3abc0 req-73bd24d6-d558-4cd0-9e7d-e23cbc8da87e service nova] Enqueued Resource ID: aa62d620-3698-4ee3-b4b9-f3aaf937876a with Priority: HIGHEST for action port [ 878.800166] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_rules [ 878.800166] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 878.800166] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa62d620-3698-4ee3-b4b9-f3aaf937876a with Priority: HIGHEST for action port [ 878.800347] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.800470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.800534] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.800804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.800876] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.803106] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.803106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.803106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.803106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.803106] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.803106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.803405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.803405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.803405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.803522] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.804882] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa62d620-3698-4ee3-b4b9-f3aaf937876a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.805037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa62d620-3698-4ee3-b4b9-f3aaf937876a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.805108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa62d620-3698-4ee3-b4b9-f3aaf937876a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.805335] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa62d620-3698-4ee3-b4b9-f3aaf937876a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.805433] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa62d620-3698-4ee3-b4b9-f3aaf937876a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.029682] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e in Status: SUCCESS [ 879.029943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.303772] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.306172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.306172] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.306873] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa62d620-3698-4ee3-b4b9-f3aaf937876a with status ACTIVE [ 879.307120] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.307245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.307310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.307553] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.307680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.309283] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.309580] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.309681] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.309870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.310145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.310375] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.310477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.310538] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.310698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.310777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.310863] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa62d620-3698-4ee3-b4b9-f3aaf937876a is going to be updated. [ 879.333122] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.333435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.333521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.333728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.333867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.334039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa62d620-3698-4ee3-b4b9-f3aaf937876a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.809404] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.313133] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.313304] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.313375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.313667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.313769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.313873] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 is going to be created. [ 880.345565] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.345724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.345796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.346030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.346204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.356717] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: UNINITIALIZED for 2s [ 882.372030] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: SUCCESS [ 882.372030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.372030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.372030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.372030] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.372030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.372030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.372030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.372030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.372030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.372030] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.666614] env[69499]: INFO networking_nsxv3.common.synchronization [req-d1278ee9-7fc7-473d-b332-be6ea4290755 req-516e659c-c1aa-4cce-bca7-f93df61e0d8e tempest-ServerAddressesNegativeTestJSON-1386963904 tempest-ServerAddressesNegativeTestJSON-1386963904-project-member] Enqueued Resource ID: ed300e57-2eef-458b-9bd5-cd62d0872060 with Priority: HIGHEST for action security_group_members [ 882.667336] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed300e57-2eef-458b-9bd5-cd62d0872060 with Priority: HIGHEST for action security_group_members [ 882.668217] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed300e57-2eef-458b-9bd5-cd62d0872060 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.668217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.668217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.668939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.669276] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.672026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.672026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.672026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.672026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.672026] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed300e57-2eef-458b-9bd5-cd62d0872060',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.875597] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.875844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.875943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.876246] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.876443] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.876627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.876750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.876858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.876956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.877089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.877286] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.877386] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.877441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.877590] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.877734] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.877822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.877917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.878084] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.878165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.878249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.878359] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.173426] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.173588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.173637] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.173882] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.173976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.174202] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.174313] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.174364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.174571] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.174648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.174722] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed300e57-2eef-458b-9bd5-cd62d0872060 is going to be updated. [ 883.202753] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.202941] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.203019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.203397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.203592] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.212867] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed300e57-2eef-458b-9bd5-cd62d0872060 in Status: IN_PROGRESS for 2s [ 883.381475] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39342f68-f184-4c9d-a63b-6e7eb4959f38: rpc.has_security_group_logging(os_id): False [ 883.400047] env[69499]: INFO networking_nsxv3.common.synchronization [req-f2c649cd-d1d6-4a85-a2c7-f3dd9cd556ce req-4339450b-2d97-4e09-ab68-15bd27a3c75a tempest-ListServerFiltersTestJSON-1505479587 tempest-ListServerFiltersTestJSON-1505479587-project-member] Enqueued Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 883.400941] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.401174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.401260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.401585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.401698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.401930] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.402136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.402136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.402262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.402346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.402695] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.402823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.402880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.403020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.403136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.403289] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.403374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.403431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.403641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.403750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.403838] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 is going to be created. [ 883.405435] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 883.406080] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.406225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.406305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.406477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.406628] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.406718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.406815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.406967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.407071] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.407143] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.462690] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.462942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.463137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.463269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.463559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.474747] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: IN_PROGRESS for 2s [ 883.830124] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-261 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.830590] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-261" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.830590] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-261" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.830743] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-261" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.831238] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.831435] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.831564] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.831859] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.832064] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.832315] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 883.832441] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.832559] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.832674] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.832787] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 883.832898] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.833047] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.850581] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.850770] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 883.850917] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.851139] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-261" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.851437] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-a92642bc-688c-491c-8e46-bd58a5112296 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.851617] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-a92642bc-688c-491c-8e46-bd58a5112296" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.851742] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-a92642bc-688c-491c-8e46-bd58a5112296" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.852100] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-a92642bc-688c-491c-8e46-bd58a5112296" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.852246] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a92642bc-688c-491c-8e46-bd58a5112296',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.910834] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.355102] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.355355] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.355489] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.355808] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.356007] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.356201] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port a92642bc-688c-491c-8e46-bd58a5112296 not found, creating... [ 884.356622] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.356789] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.356905] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.357153] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.357342] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.357589] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.357752] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.357875] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.358104] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.358245] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.358390] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: a92642bc-688c-491c-8e46-bd58a5112296 is going to be created. [ 884.377782] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.378040] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.378182] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.378483] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.378793] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.379040] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-a92642bc-688c-491c-8e46-bd58a5112296" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.412777] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.915334] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.915482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.915616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.915947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.917149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.917149] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 is going to be updated. [ 884.942361] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.942645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.942762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.943015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.943220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.951179] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: IN_PROGRESS for 2s [ 885.161203] env[69499]: INFO networking_nsxv3.common.synchronization [req-f2c649cd-d1d6-4a85-a2c7-f3dd9cd556ce req-8f8eccce-91bf-45e6-8dbf-088c05a36697 service nova] Enqueued Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_rules [ 885.161203] env[69499]: INFO networking_nsxv3.common.synchronization [req-f2c649cd-d1d6-4a85-a2c7-f3dd9cd556ce req-8f8eccce-91bf-45e6-8dbf-088c05a36697 service nova] Enqueued Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 885.161203] env[69499]: INFO networking_nsxv3.common.synchronization [req-f2c649cd-d1d6-4a85-a2c7-f3dd9cd556ce req-8f8eccce-91bf-45e6-8dbf-088c05a36697 service nova] Enqueued Resource ID: a92642bc-688c-491c-8e46-bd58a5112296 with Priority: HIGHEST for action port [ 885.161203] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_rules [ 885.161203] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 885.161203] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a92642bc-688c-491c-8e46-bd58a5112296 with Priority: HIGHEST for action port [ 885.161203] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.161203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.161203] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.163674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.163674] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-a92642bc-688c-491c-8e46-bd58a5112296 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.163674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a92642bc-688c-491c-8e46-bd58a5112296" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.163674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a92642bc-688c-491c-8e46-bd58a5112296" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.163674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a92642bc-688c-491c-8e46-bd58a5112296" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.163674] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a92642bc-688c-491c-8e46-bd58a5112296',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.226775] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed300e57-2eef-458b-9bd5-cd62d0872060 in Status: SUCCESS [ 885.226978] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed300e57-2eef-458b-9bd5-cd62d0872060 deletion is rescheduled due to dependency. [ 885.227089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.486842] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: SUCCESS [ 885.487093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.487277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.487500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.487626] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.666079] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a92642bc-688c-491c-8e46-bd58a5112296 with status ACTIVE [ 885.666371] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.666570] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.666674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.666909] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.667142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.671066] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.671066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.671066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.671066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.671066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.671066] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.671066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.671066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.671066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.671066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.671066] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a92642bc-688c-491c-8e46-bd58a5112296 is going to be updated. [ 885.695274] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.695457] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.695531] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.695846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.695916] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.696054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a92642bc-688c-491c-8e46-bd58a5112296" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.991145] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.991291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.689709] env[69499]: INFO networking_nsxv3.common.synchronization [None req-5747a8e5-feb7-4e07-9e64-c7343a6afb13 None None] Enqueued Resource ID: 7ff42794-22b9-490b-a063-aa3bdd216ef2 with Priority: HIGHEST for action port [ 886.690364] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff42794-22b9-490b-a063-aa3bdd216ef2 with Priority: HIGHEST for action port [ 886.690818] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ff42794-22b9-490b-a063-aa3bdd216ef2 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.691032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ff42794-22b9-490b-a063-aa3bdd216ef2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.694369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ff42794-22b9-490b-a063-aa3bdd216ef2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.696108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ff42794-22b9-490b-a063-aa3bdd216ef2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.696108] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ff42794-22b9-490b-a063-aa3bdd216ef2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.962424] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: SUCCESS [ 886.963626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.964418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.964727] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.964989] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.965192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.965277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.965461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.966734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.967376] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.198033] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ff42794-22b9-490b-a063-aa3bdd216ef2 [ 887.198685] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.198685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.198685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.198829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.198829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.199415] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ff42794-22b9-490b-a063-aa3bdd216ef2 already deleted. [ 887.199415] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ff42794-22b9-490b-a063-aa3bdd216ef2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.264174] env[69499]: INFO networking_nsxv3.common.synchronization [None req-acffc657-72f6-47bd-9237-438eb9a10ab2 tempest-ServersTestBootFromVolume-649135408 tempest-ServersTestBootFromVolume-649135408-project-member] Enqueued Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGHEST for action security_group_rules [ 887.266021] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGHEST for action security_group_rules [ 887.266021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.266021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.266021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.266021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.266021] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd1b70ed-24ca-4742-b6ba-0af6127fef74',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.361518] env[69499]: INFO networking_nsxv3.common.synchronization [None req-52bde687-b20a-4ad4-8c16-7ffac23e9860 tempest-ServersTestBootFromVolume-649135408 tempest-ServersTestBootFromVolume-649135408-project-member] Enqueued Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGHEST for action security_group_rules [ 887.361565] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGHEST for action security_group_rules [ 887.361994] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.361994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.471858] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.786931] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.787758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.787895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.788162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.788261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.788367] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 already deleted. [ 887.788452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.788687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.788895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.789048] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd1b70ed-24ca-4742-b6ba-0af6127fef74',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.977966] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.310026] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.310145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.310492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.310492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.310608] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.310650] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 already deleted. [ 888.311102] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.480392] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.480660] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.480792] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.481174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.481312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.481470] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 is going to be updated. [ 888.512971] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.512971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.512971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.512971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.512971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.520470] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: IN_PROGRESS for 2s [ 889.138033] env[69499]: INFO networking_nsxv3.common.synchronization [None req-ab1b441d-b7b2-418c-8f16-5f5175bd909b None None] Enqueued Resource ID: e74fa263-7bd5-4239-a058-86ed97b1a2ef with Priority: HIGHEST for action port [ 889.143115] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e74fa263-7bd5-4239-a058-86ed97b1a2ef with Priority: HIGHEST for action port [ 889.143115] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e74fa263-7bd5-4239-a058-86ed97b1a2ef taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.143115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e74fa263-7bd5-4239-a058-86ed97b1a2ef" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.143115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e74fa263-7bd5-4239-a058-86ed97b1a2ef" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.143115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e74fa263-7bd5-4239-a058-86ed97b1a2ef" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.143115] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e74fa263-7bd5-4239-a058-86ed97b1a2ef',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.395531] env[69499]: INFO networking_nsxv3.common.synchronization [req-8aa02d50-5b2c-4e67-8b3a-1e9f4a1b2637 req-f73fea24-717b-45a3-9716-7609331e68b4 tempest-ServerDiskConfigTestJSON-146039362 tempest-ServerDiskConfigTestJSON-146039362-project-member] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 889.396073] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 889.396950] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.396950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.396950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.396950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.396950] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.397185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.397895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.398221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.398310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.401055] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.449133] env[69499]: INFO networking_nsxv3.common.synchronization [req-531f44ce-58c9-4895-b07a-f3d249e53b01 req-6ad77306-f18d-4878-9ee0-65704cec4eee tempest-ImagesTestJSON-490670806 tempest-ImagesTestJSON-490670806-project-member] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 889.450028] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 889.450138] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.450319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.453193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.453346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.453529] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.453917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.453917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.453917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.454062] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.454062] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.644422] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e74fa263-7bd5-4239-a058-86ed97b1a2ef [ 889.644708] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.644875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.644961] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.645192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.645274] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.645364] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e74fa263-7bd5-4239-a058-86ed97b1a2ef already deleted. [ 889.645442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e74fa263-7bd5-4239-a058-86ed97b1a2ef" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.901106] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.901311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.901357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.901571] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.901686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.901887] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.901939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.902013] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.902175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.902298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.902342] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be updated. [ 889.926557] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.926776] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.926776] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.926996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.927469] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.936695] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 889.959819] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.462254] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.512966] env[69499]: INFO networking_nsxv3.common.synchronization [None req-50f219fb-c1d6-4e02-a527-5a8e484e0543 None None] Enqueued Resource ID: c75a7bcf-a70b-4dd5-a2fb-90790579e8ab with Priority: HIGHEST for action port [ 890.513609] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75a7bcf-a70b-4dd5-a2fb-90790579e8ab with Priority: HIGHEST for action port [ 890.513923] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-c75a7bcf-a70b-4dd5-a2fb-90790579e8ab taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.514137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c75a7bcf-a70b-4dd5-a2fb-90790579e8ab" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.514301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c75a7bcf-a70b-4dd5-a2fb-90790579e8ab" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.514592] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c75a7bcf-a70b-4dd5-a2fb-90790579e8ab" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.514710] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c75a7bcf-a70b-4dd5-a2fb-90790579e8ab',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.530533] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: SUCCESS [ 890.530825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.532370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.532370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.532370] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.532370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.532370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.532370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.532370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.532708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.532708] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.966470] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.966470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.966470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.966470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.966470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.966470] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 890.993907] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.994101] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.994198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.995057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.995057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.007126] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 891.025078] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c75a7bcf-a70b-4dd5-a2fb-90790579e8ab [ 891.025389] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.025606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.025663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.026085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.026214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.026346] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c75a7bcf-a70b-4dd5-a2fb-90790579e8ab already deleted. [ 891.026500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c75a7bcf-a70b-4dd5-a2fb-90790579e8ab" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.035821] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.035821] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.035821] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.036133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.036133] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.036215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.036215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.039117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.039117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.039117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.039117] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.039117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.039117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.039117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.039117] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.039117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.039117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.039117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.039117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.039117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.039117] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.068335] env[69499]: INFO networking_nsxv3.common.synchronization [req-96d4351a-d3f9-4541-b3dc-8d9ef6b8ee30 req-97080465-5e2d-4f9e-aec6-468dcb115e80 tempest-MigrationsAdminTest-725814107 tempest-MigrationsAdminTest-725814107-project-member] Enqueued Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_members [ 891.068913] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_members [ 891.069660] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.069660] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.069660] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.069660] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.069930] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.069930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.070042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.072678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.072678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.072678] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.544825] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39342f68-f184-4c9d-a63b-6e7eb4959f38: rpc.has_security_group_logging(os_id): False [ 891.563736] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.563736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.563736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.563736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.563736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.563736] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.563736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.563736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.564068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.564068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.564189] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.564284] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.564384] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.564525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.564556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.564732] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.564815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.564877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.565352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.565579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.566192] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 is going to be updated. [ 891.573364] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.627507] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.627507] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.627507] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.627507] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.627507] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.638677] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: IN_PROGRESS for 2s [ 891.948958] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 891.949169] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 deletion is rescheduled due to dependency. [ 891.949287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.075537] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.581401] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.581401] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.581401] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.581401] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.581401] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.581401] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c is going to be updated. [ 892.606170] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.606296] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.606368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.606582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.606726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.614688] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: IN_PROGRESS for 2s [ 892.663672] env[69499]: INFO networking_nsxv3.common.synchronization [None req-1069d4cf-f13c-44ea-aea5-fcb2c3321610 None None] Enqueued Resource ID: e7cd1f84-c3d8-4083-9b7d-7c620ea187ec with Priority: HIGHEST for action port [ 892.664213] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7cd1f84-c3d8-4083-9b7d-7c620ea187ec with Priority: HIGHEST for action port [ 892.664549] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7cd1f84-c3d8-4083-9b7d-7c620ea187ec taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.664704] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7cd1f84-c3d8-4083-9b7d-7c620ea187ec" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.664775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7cd1f84-c3d8-4083-9b7d-7c620ea187ec" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.667938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7cd1f84-c3d8-4083-9b7d-7c620ea187ec" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.668086] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7cd1f84-c3d8-4083-9b7d-7c620ea187ec',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.016226] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 893.016454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.173087] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7cd1f84-c3d8-4083-9b7d-7c620ea187ec [ 893.173409] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.173591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.173687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.173968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.174092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.174217] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7cd1f84-c3d8-4083-9b7d-7c620ea187ec already deleted. [ 893.174325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7cd1f84-c3d8-4083-9b7d-7c620ea187ec" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.652078] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: SUCCESS [ 893.652381] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.389338] env[69499]: INFO networking_nsxv3.common.synchronization [req-fabb2ff9-cb2a-4c9e-bc38-5d4450e45287 req-e2927bb8-8681-475c-9224-c989c728ffcc tempest-ServersAdminTestJSON-2112223204 tempest-ServersAdminTestJSON-2112223204-project-member] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 894.390029] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 894.390416] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.390579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.390669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.390914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.391112] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.391243] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.391307] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.391496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.391602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.391707] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.590634] env[69499]: INFO networking_nsxv3.common.synchronization [req-a0f1a249-b84a-44a0-826e-48fa34759d3e req-aea59a04-5995-4584-8de5-e13c6efb11dd tempest-ListServerFiltersTestJSON-1505479587 tempest-ListServerFiltersTestJSON-1505479587-project-member] Enqueued Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 894.594245] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 894.594245] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.594245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.594245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.594245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.594245] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.594245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.594245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.594245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.594245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.594245] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.624681] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: SUCCESS [ 894.624858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.894806] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.973249] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-261 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.973449] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-261" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.973580] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-261" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.973856] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-261" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.974130] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.974293] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.974416] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.974641] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.974790] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.975013] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.975189] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.975303] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.975415] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.975527] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.975637] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.975797] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.993978] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.994336] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 894.994625] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.994999] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-261" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.995459] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-a5dc7f7e-1754-43b9-97eb-be52334795b9 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.995782] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-a5dc7f7e-1754-43b9-97eb-be52334795b9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.996050] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-a5dc7f7e-1754-43b9-97eb-be52334795b9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.996510] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-a5dc7f7e-1754-43b9-97eb-be52334795b9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.996801] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5dc7f7e-1754-43b9-97eb-be52334795b9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.095558] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.391705] env[69499]: INFO networking_nsxv3.common.synchronization [req-2c1807c1-8163-49d2-b15a-5646c939b661 req-cc9ecc4c-00cb-43ae-9d2d-8c8414501070 tempest-VolumesAdminNegativeTest-1747404511 tempest-VolumesAdminNegativeTest-1747404511-project-member] Enqueued Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGHEST for action security_group_members [ 895.392312] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGHEST for action security_group_members [ 895.392674] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c134d579-1162-46e0-bee7-73f3403c9135 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.392834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.392925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.393148] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.393331] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.393458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.393543] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.393650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.393738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.393877] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c134d579-1162-46e0-bee7-73f3403c9135',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.398156] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.502223] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.502223] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.502223] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.502223] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.502223] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.502223] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port a5dc7f7e-1754-43b9-97eb-be52334795b9 not found, creating... [ 895.502223] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.502223] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.502223] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.502223] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.502223] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.502576] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.502576] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.502576] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.503093] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.503404] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.503703] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: a5dc7f7e-1754-43b9-97eb-be52334795b9 is going to be created. [ 895.522472] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.522648] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.522778] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.523046] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.523278] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.523492] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-a5dc7f7e-1754-43b9-97eb-be52334795b9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.597637] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.896294] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.896632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.896632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.896887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.897568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.897568] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.897568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.897568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.897568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.897851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.897901] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c134d579-1162-46e0-bee7-73f3403c9135 is going to be updated. [ 895.899544] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.899729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.899849] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.900058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.900197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.900324] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be updated. [ 895.925604] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.925807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.925903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.926123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.926368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.928347] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.928475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.928529] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.928699] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.928817] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.936821] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 895.937459] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c134d579-1162-46e0-bee7-73f3403c9135 in Status: IN_PROGRESS for 2s [ 896.103553] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.103732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.103792] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.104119] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.104214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.104317] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 is going to be updated. [ 896.131616] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.131767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.131831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.132088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.132206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.141824] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: IN_PROGRESS for 2s [ 896.300269] env[69499]: INFO networking_nsxv3.common.synchronization [req-a0f1a249-b84a-44a0-826e-48fa34759d3e req-282a0978-7fb0-49c9-8d51-91f776d693da service nova] Enqueued Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_rules [ 896.300269] env[69499]: INFO networking_nsxv3.common.synchronization [req-a0f1a249-b84a-44a0-826e-48fa34759d3e req-282a0978-7fb0-49c9-8d51-91f776d693da service nova] Enqueued Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 896.300269] env[69499]: INFO networking_nsxv3.common.synchronization [req-a0f1a249-b84a-44a0-826e-48fa34759d3e req-282a0978-7fb0-49c9-8d51-91f776d693da service nova] Enqueued Resource ID: a5dc7f7e-1754-43b9-97eb-be52334795b9 with Priority: HIGHEST for action port [ 896.300269] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_rules [ 896.300269] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 896.300269] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5dc7f7e-1754-43b9-97eb-be52334795b9 with Priority: HIGHEST for action port [ 896.301722] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.302940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.302940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.302940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.302940] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.303452] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.303552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.304395] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5dc7f7e-1754-43b9-97eb-be52334795b9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.304521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5dc7f7e-1754-43b9-97eb-be52334795b9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.304589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5dc7f7e-1754-43b9-97eb-be52334795b9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.304793] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5dc7f7e-1754-43b9-97eb-be52334795b9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.304865] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5dc7f7e-1754-43b9-97eb-be52334795b9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.808075] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.808203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.808398] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5dc7f7e-1754-43b9-97eb-be52334795b9 with status ACTIVE [ 896.808564] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.808718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.808789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.809014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.809113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.812979] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.812979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.812979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.812979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.812979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.812979] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.812979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.812979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.812979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.812979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.812979] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5dc7f7e-1754-43b9-97eb-be52334795b9 is going to be updated. [ 896.834289] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.834444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.834488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.834682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.834835] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.835424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5dc7f7e-1754-43b9-97eb-be52334795b9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.947241] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 897.947552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.948199] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c134d579-1162-46e0-bee7-73f3403c9135 in Status: SUCCESS [ 897.948387] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c134d579-1162-46e0-bee7-73f3403c9135 deletion is rescheduled due to dependency. [ 897.948506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.151147] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: SUCCESS [ 898.151490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.151698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.151947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.152188] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.152281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.152348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.152511] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.152599] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.152699] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.655787] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.158231] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.661689] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.661856] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.661928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.662169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.662263] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.662363] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 is going to be updated. [ 899.687197] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.687313] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.687313] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.687498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.687629] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.694989] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: IN_PROGRESS for 2s [ 901.302343] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 901.302343] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 901.635375] env[69499]: INFO networking_nsxv3.common.synchronization [None req-c0a15dea-5273-4560-a834-3bb4434f2f03 tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f with Priority: HIGHEST for action security_group_rules [ 901.640021] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f with Priority: HIGHEST for action security_group_rules [ 901.640021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29ac832b-134e-49c9-ac8a-2171fbc0640f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.640021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.640021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.640021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.640021] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29ac832b-134e-49c9-ac8a-2171fbc0640f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.707968] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: SUCCESS [ 901.708230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.708391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.708670] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.708840] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.708981] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.709069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.709251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.709336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.709423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.709515] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.785338] env[69499]: INFO networking_nsxv3.common.synchronization [None req-0e420f81-e0d0-48b6-9e1d-2ffcfd9de1ec tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f with Priority: HIGHEST for action security_group_rules [ 901.786028] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f with Priority: HIGHEST for action security_group_rules [ 901.786404] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29ac832b-134e-49c9-ac8a-2171fbc0640f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.786513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.158165] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.158352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.158456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.158812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.158949] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.159139] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f already deleted. [ 902.159245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.160125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.160125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.160125] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29ac832b-134e-49c9-ac8a-2171fbc0640f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.212402] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.212561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.212636] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.212859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.213032] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.213135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.213199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.213378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.213481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.213573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.213722] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.213820] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.213876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.214064] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.214180] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.214269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.214321] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.214503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.214535] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.214608] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.214700] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.244800] env[69499]: INFO networking_nsxv3.common.synchronization [None req-409da77e-484a-4212-be80-b2cbbe113ef7 tempest-AttachVolumeTestJSON-2079313698 tempest-AttachVolumeTestJSON-2079313698-project-member] Enqueued Resource ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 with Priority: HIGHEST for action security_group_rules [ 902.245493] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 with Priority: HIGHEST for action security_group_rules [ 902.246335] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a7f6a50-148b-4bd4-8db5-07c132b22182 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.246461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.246529] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.246792] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.246919] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a7f6a50-148b-4bd4-8db5-07c132b22182',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.366775] env[69499]: INFO networking_nsxv3.common.synchronization [None req-d9391a0d-4dd1-4a4f-a5da-19b74c2627e3 tempest-AttachVolumeTestJSON-2079313698 tempest-AttachVolumeTestJSON-2079313698-project-member] Enqueued Resource ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 with Priority: HIGHEST for action security_group_rules [ 902.366775] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 with Priority: HIGHEST for action security_group_rules [ 902.366775] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a7f6a50-148b-4bd4-8db5-07c132b22182 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.366775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.679170] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.679416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.679513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.679734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.679889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.679935] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f already deleted. [ 902.680009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.721311] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39342f68-f184-4c9d-a63b-6e7eb4959f38: rpc.has_security_group_logging(os_id): False [ 902.737897] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.738077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.738150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.738359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.738449] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.738715] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.738850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.738889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.739075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.739125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.739291] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.739383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.739443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.739603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.739684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.739870] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.739963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.741245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.741479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.742530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.742711] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 is going to be updated. [ 902.766935] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.766935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.766935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.767149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.767282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.767515] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 already deleted. [ 902.767515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.767610] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.767718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.767800] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a7f6a50-148b-4bd4-8db5-07c132b22182',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.811565] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.811704] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.811774] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.812074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.812234] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.826865] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: IN_PROGRESS for 2s [ 903.289546] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.289546] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.289748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.289984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.290264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.290424] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 already deleted. [ 903.291260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.840819] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: SUCCESS [ 904.841121] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.366171] env[69499]: INFO networking_nsxv3.common.synchronization [req-5da50ef2-8f0e-410b-aef1-079dd73f1a7a req-da2a6ee1-acc4-43e5-9329-1a2e51229f18 tempest-ServerActionsTestJSON-629709431 tempest-ServerActionsTestJSON-629709431-project-member] Enqueued Resource ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea with Priority: HIGHEST for action security_group_members [ 906.366633] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea with Priority: HIGHEST for action security_group_members [ 906.367039] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.367191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.367265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.367548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.367978] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.368114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.368192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.368383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.368473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.368888] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.700039] env[69499]: INFO networking_nsxv3.common.synchronization [None req-d5a8a1c6-c221-49b1-af16-2e1ac15bc87a None None] Enqueued Resource ID: 0de1afa8-a4a1-4ea4-8978-9d1df4f78853 with Priority: HIGHEST for action port [ 906.700651] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0de1afa8-a4a1-4ea4-8978-9d1df4f78853 with Priority: HIGHEST for action port [ 906.701957] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-0de1afa8-a4a1-4ea4-8978-9d1df4f78853 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.702133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0de1afa8-a4a1-4ea4-8978-9d1df4f78853" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.702205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0de1afa8-a4a1-4ea4-8978-9d1df4f78853" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.702475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0de1afa8-a4a1-4ea4-8978-9d1df4f78853" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.702562] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0de1afa8-a4a1-4ea4-8978-9d1df4f78853',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.721017] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-76 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.721017] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.721017] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.721017] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.721017] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.721017] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.721017] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.721017] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.721442] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.721442] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.721501] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.721960] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.721960] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.721960] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.722125] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.723351] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.742991] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.743182] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 906.743325] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.743512] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.743837] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-4e037e26-70af-4d04-9328-c1c26a70b84a taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.744021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-4e037e26-70af-4d04-9328-c1c26a70b84a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.744148] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-4e037e26-70af-4d04-9328-c1c26a70b84a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.744464] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-4e037e26-70af-4d04-9328-c1c26a70b84a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.744608] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e037e26-70af-4d04-9328-c1c26a70b84a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.871951] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.872160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.872237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.872452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.872542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.872730] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.872825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.872890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.873044] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.873125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.873209] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea already deleted. [ 906.873295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.206008] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0de1afa8-a4a1-4ea4-8978-9d1df4f78853 [ 907.206751] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.206751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.206751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.206751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.206751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.206751] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0de1afa8-a4a1-4ea4-8978-9d1df4f78853 already deleted. [ 907.206751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0de1afa8-a4a1-4ea4-8978-9d1df4f78853" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.248183] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.248183] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.248349] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.248592] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.249566] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.249566] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 4e037e26-70af-4d04-9328-c1c26a70b84a not found, creating... [ 907.249566] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.249566] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.249566] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.250025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.250025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.250286] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.250449] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.250567] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.250793] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.250914] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.251223] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 4e037e26-70af-4d04-9328-c1c26a70b84a is going to be created. [ 907.271496] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.271785] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.271965] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.272266] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.272540] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.272796] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-4e037e26-70af-4d04-9328-c1c26a70b84a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.095368] env[69499]: INFO networking_nsxv3.common.synchronization [req-5da50ef2-8f0e-410b-aef1-079dd73f1a7a req-d6418c47-039e-488c-a6fe-a24d9f1ece55 service nova] Enqueued Resource ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea with Priority: HIGHEST for action security_group_rules [ 908.095368] env[69499]: INFO networking_nsxv3.common.synchronization [req-5da50ef2-8f0e-410b-aef1-079dd73f1a7a req-d6418c47-039e-488c-a6fe-a24d9f1ece55 service nova] Enqueued Resource ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea with Priority: HIGHEST for action security_group_members [ 908.095368] env[69499]: INFO networking_nsxv3.common.synchronization [req-5da50ef2-8f0e-410b-aef1-079dd73f1a7a req-d6418c47-039e-488c-a6fe-a24d9f1ece55 service nova] Enqueued Resource ID: 4e037e26-70af-4d04-9328-c1c26a70b84a with Priority: HIGHEST for action port [ 908.095368] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea with Priority: HIGHEST for action security_group_rules [ 908.095368] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea with Priority: HIGHEST for action security_group_members [ 908.095368] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e037e26-70af-4d04-9328-c1c26a70b84a with Priority: HIGHEST for action port [ 908.095753] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.095797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.095834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.096058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.096152] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.097271] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.097406] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.097472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.097650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.097800] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.097891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.097952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.098126] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.098186] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.098271] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.103485] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e037e26-70af-4d04-9328-c1c26a70b84a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.103485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e037e26-70af-4d04-9328-c1c26a70b84a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.103485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e037e26-70af-4d04-9328-c1c26a70b84a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.103680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e037e26-70af-4d04-9328-c1c26a70b84a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.103771] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e037e26-70af-4d04-9328-c1c26a70b84a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.603668] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.612210] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.612210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.612210] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e037e26-70af-4d04-9328-c1c26a70b84a with status ACTIVE [ 908.612210] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.612210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.612210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.612210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.612210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.612210] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.612210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.612210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.612210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.612210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.612210] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.612724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.612724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.612724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.612724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.612724] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e037e26-70af-4d04-9328-c1c26a70b84a is going to be updated. [ 908.633644] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.633644] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.633644] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.633920] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.633975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.634990] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e037e26-70af-4d04-9328-c1c26a70b84a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.913472] env[69499]: INFO networking_nsxv3.common.synchronization [req-2419395e-4d19-40ff-a02f-8702c22ab828 req-d7954d04-db34-471d-aa78-3d32db988673 tempest-ServerRescueNegativeTestJSON-106874270 tempest-ServerRescueNegativeTestJSON-106874270-project-member] Enqueued Resource ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce with Priority: HIGHEST for action security_group_members [ 908.913986] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce with Priority: HIGHEST for action security_group_members [ 908.914326] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.915031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.915031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.915031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.915031] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.915031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.919212] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.919341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.919439] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.919538] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b43d2067-f3a1-4ba4-a448-6e853d1bb2ce',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.116108] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.208976] env[69499]: INFO networking_nsxv3.common.synchronization [None req-6684cc2b-acd0-4c13-9d93-b93ddd449a29 None None] Enqueued Resource ID: 60325c5e-9b48-4f4a-a7a1-b2ea6f13dbe1 with Priority: HIGHEST for action port [ 909.209241] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60325c5e-9b48-4f4a-a7a1-b2ea6f13dbe1 with Priority: HIGHEST for action port [ 909.209801] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-60325c5e-9b48-4f4a-a7a1-b2ea6f13dbe1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.209918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60325c5e-9b48-4f4a-a7a1-b2ea6f13dbe1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.209976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60325c5e-9b48-4f4a-a7a1-b2ea6f13dbe1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.210232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60325c5e-9b48-4f4a-a7a1-b2ea6f13dbe1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.210314] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60325c5e-9b48-4f4a-a7a1-b2ea6f13dbe1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.350144] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-666 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.350303] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-666" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.350430] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-666" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.350720] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-666" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.351039] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.351952] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.352095] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.357050] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.357050] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.357050] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 909.357050] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 909.357050] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 909.357050] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 909.357050] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 909.357050] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 909.357050] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 909.374644] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 909.374934] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 909.375125] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 909.375372] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-666" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.375907] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-7a9ec0d5-27c8-49c0-9449-bed4d5e94d53 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.375907] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-7a9ec0d5-27c8-49c0-9449-bed4d5e94d53" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.376084] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-7a9ec0d5-27c8-49c0-9449-bed4d5e94d53" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.376437] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-7a9ec0d5-27c8-49c0-9449-bed4d5e94d53" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.376624] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a9ec0d5-27c8-49c0-9449-bed4d5e94d53',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.421995] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.422220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.422282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.422456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.422541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.423869] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.423869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.423869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.423869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.423869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.423869] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce already deleted. [ 909.423869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.623719] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.623955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.623955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.624171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.624264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.624366] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea is going to be created. [ 909.647244] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.647441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.647481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.647757] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.647969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.656619] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea in Status: UNINITIALIZED for 2s [ 909.716160] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60325c5e-9b48-4f4a-a7a1-b2ea6f13dbe1 [ 909.716404] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.716533] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.716602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.716858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.716954] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.717068] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60325c5e-9b48-4f4a-a7a1-b2ea6f13dbe1 already deleted. [ 909.717153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60325c5e-9b48-4f4a-a7a1-b2ea6f13dbe1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.879130] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.879485] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.880030] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.880146] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.880397] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.880654] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 7a9ec0d5-27c8-49c0-9449-bed4d5e94d53 not found, creating... [ 909.881096] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.881374] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.881583] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.881953] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.882219] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.882701] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.883034] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.883182] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.883538] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.883789] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.883994] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 7a9ec0d5-27c8-49c0-9449-bed4d5e94d53 is going to be created. [ 909.904385] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.904722] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.904941] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.905376] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.905740] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.906110] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-7a9ec0d5-27c8-49c0-9449-bed4d5e94d53" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.985548] env[69499]: INFO networking_nsxv3.common.synchronization [req-2419395e-4d19-40ff-a02f-8702c22ab828 req-01e6eeb2-8c9f-46a8-b12f-dbe9ecff235f service nova] Enqueued Resource ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce with Priority: HIGHEST for action security_group_rules [ 910.985858] env[69499]: INFO networking_nsxv3.common.synchronization [req-2419395e-4d19-40ff-a02f-8702c22ab828 req-01e6eeb2-8c9f-46a8-b12f-dbe9ecff235f service nova] Enqueued Resource ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce with Priority: HIGHEST for action security_group_members [ 910.985858] env[69499]: INFO networking_nsxv3.common.synchronization [req-2419395e-4d19-40ff-a02f-8702c22ab828 req-01e6eeb2-8c9f-46a8-b12f-dbe9ecff235f service nova] Enqueued Resource ID: 7a9ec0d5-27c8-49c0-9449-bed4d5e94d53 with Priority: HIGHEST for action port [ 910.986101] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce with Priority: HIGHEST for action security_group_rules [ 910.986238] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce with Priority: HIGHEST for action security_group_members [ 910.986340] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a9ec0d5-27c8-49c0-9449-bed4d5e94d53 with Priority: HIGHEST for action port [ 910.986909] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.987405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.987405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.987405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.987405] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b43d2067-f3a1-4ba4-a448-6e853d1bb2ce',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.988259] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.988374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.988439] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.992177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.992354] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.992463] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.992531] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.992698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.992786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.992892] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b43d2067-f3a1-4ba4-a448-6e853d1bb2ce',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.995452] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a9ec0d5-27c8-49c0-9449-bed4d5e94d53 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.995452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a9ec0d5-27c8-49c0-9449-bed4d5e94d53" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.995452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a9ec0d5-27c8-49c0-9449-bed4d5e94d53" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.995452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a9ec0d5-27c8-49c0-9449-bed4d5e94d53" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.995452] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a9ec0d5-27c8-49c0-9449-bed4d5e94d53',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.496581] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.497266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.497266] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b43d2067-f3a1-4ba4-a448-6e853d1bb2ce',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.498231] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a9ec0d5-27c8-49c0-9449-bed4d5e94d53 with status ACTIVE [ 911.498464] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.498620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.498740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.498974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.500634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.500906] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.501060] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.501156] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.501736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.503024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.503024] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.503024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.503024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.503024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.503024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.503024] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a9ec0d5-27c8-49c0-9449-bed4d5e94d53 is going to be updated. [ 911.524204] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.524447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.524569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.524873] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.525101] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.525412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a9ec0d5-27c8-49c0-9449-bed4d5e94d53" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.666490] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea in Status: SUCCESS [ 911.667850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.668430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.668653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.668901] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.669048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.669137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.669302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.669424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.669522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.669634] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.005149] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b43d2067-f3a1-4ba4-a448-6e853d1bb2ce',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.173555] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.507961] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.508337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.508510] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.508853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.509200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.509400] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce is going to be created. [ 912.533668] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.533668] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.536403] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.536403] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.536403] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.543643] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce in Status: UNINITIALIZED for 2s [ 912.678180] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea: rpc.has_security_group_logging(os_id): False [ 912.696616] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.696860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.696929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.697206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.697325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.697667] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.697803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.697881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.698081] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.698159] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.698328] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea is going to be created. [ 912.752416] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.752564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.752641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.752851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.754038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.764215] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea in Status: IN_PROGRESS for 2s [ 913.646969] env[69499]: INFO networking_nsxv3.common.synchronization [req-840b1aab-af0d-4c9c-b045-163c286e4a66 req-f3b5ae55-f03d-46eb-acc1-a92a9bdecd9d tempest-ImagesOneServerNegativeTestJSON-1949881093 tempest-ImagesOneServerNegativeTestJSON-1949881093-project-member] Enqueued Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 913.647565] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 913.647906] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.648784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.648904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.649113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.649280] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.649418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.649511] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.649680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.650263] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.650377] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.044029] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.044223] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-245" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.045047] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-245" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.045047] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-245" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.045047] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.045248] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.045248] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.045406] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.045553] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.045913] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 914.045913] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 914.046038] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 914.046122] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 914.046207] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 914.046316] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 914.047034] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 914.064138] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 914.064138] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 914.064138] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 914.064300] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-245" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.064511] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-08cff3f3-cabe-4281-9124-16090aa5179b taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.064910] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-08cff3f3-cabe-4281-9124-16090aa5179b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.064910] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-08cff3f3-cabe-4281-9124-16090aa5179b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.065130] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-08cff3f3-cabe-4281-9124-16090aa5179b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.065274] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08cff3f3-cabe-4281-9124-16090aa5179b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.156047] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.156047] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.156212] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.156356] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.156453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.156709] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.156803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.156855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.157027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.157108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.157441] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 is going to be updated. [ 914.182144] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.182144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.182323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.182383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.182526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.190062] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: IN_PROGRESS for 2s [ 914.553022] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce in Status: SUCCESS [ 914.553144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.553312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.553732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.553732] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.553889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.553889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.554094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.554182] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.554270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.554361] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b43d2067-f3a1-4ba4-a448-6e853d1bb2ce',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.567443] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.567733] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.567798] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.568106] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.568267] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.568420] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 08cff3f3-cabe-4281-9124-16090aa5179b not found, creating... [ 914.568696] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.568995] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.568995] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.569254] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.569400] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.569699] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.569862] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.569981] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.570232] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.570370] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.570525] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 08cff3f3-cabe-4281-9124-16090aa5179b is going to be created. [ 914.587926] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.588152] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.588283] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.588543] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.588800] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.589078] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-08cff3f3-cabe-4281-9124-16090aa5179b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.775294] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea in Status: SUCCESS [ 914.775548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.057164] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b43d2067-f3a1-4ba4-a448-6e853d1bb2ce',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.450829] env[69499]: INFO networking_nsxv3.common.synchronization [req-840b1aab-af0d-4c9c-b045-163c286e4a66 req-e7e3da97-ddd4-41be-a7ee-e83f92c2e643 service nova] Enqueued Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_rules [ 915.451059] env[69499]: INFO networking_nsxv3.common.synchronization [req-840b1aab-af0d-4c9c-b045-163c286e4a66 req-e7e3da97-ddd4-41be-a7ee-e83f92c2e643 service nova] Enqueued Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 915.451314] env[69499]: INFO networking_nsxv3.common.synchronization [req-840b1aab-af0d-4c9c-b045-163c286e4a66 req-e7e3da97-ddd4-41be-a7ee-e83f92c2e643 service nova] Enqueued Resource ID: 08cff3f3-cabe-4281-9124-16090aa5179b with Priority: HIGHEST for action port [ 915.453082] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_rules [ 915.453082] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 915.454119] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08cff3f3-cabe-4281-9124-16090aa5179b with Priority: HIGHEST for action port [ 915.454119] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.454119] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.454119] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.454299] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.454395] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.455273] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.455370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.455568] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-08cff3f3-cabe-4281-9124-16090aa5179b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.455672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08cff3f3-cabe-4281-9124-16090aa5179b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.455743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08cff3f3-cabe-4281-9124-16090aa5179b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.455928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08cff3f3-cabe-4281-9124-16090aa5179b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.456088] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08cff3f3-cabe-4281-9124-16090aa5179b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.559070] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b43d2067-f3a1-4ba4-a448-6e853d1bb2ce: rpc.has_security_group_logging(os_id): False [ 915.579303] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.579303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.579303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.580249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.580249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.580249] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.580249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.580249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.580249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.580475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.580475] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce is going to be created. [ 915.640412] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.640566] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.640724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.640830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.641071] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.652558] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce in Status: IN_PROGRESS for 2s [ 915.961037] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.961037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.961037] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08cff3f3-cabe-4281-9124-16090aa5179b with status ACTIVE [ 915.961037] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.961037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.961666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.961666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.961666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.961666] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.961789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.961896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.962036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.962181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.962289] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.962411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.962442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.962572] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.962872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.962872] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08cff3f3-cabe-4281-9124-16090aa5179b is going to be updated. [ 915.985923] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.985923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.985923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.985923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.985923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.985923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08cff3f3-cabe-4281-9124-16090aa5179b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.201483] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: SUCCESS [ 916.201930] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 deletion is rescheduled due to dependency. [ 916.201930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.201930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.202114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.202292] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.202959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.202959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.202959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.202959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.202959] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.364923] env[69499]: INFO networking_nsxv3.common.synchronization [req-d6043758-6dd9-420f-8fe7-97425dda8342 req-7deac976-411b-4bce-b48f-66d61ddf3a45 tempest-ServerDiskConfigTestJSON-146039362 tempest-ServerDiskConfigTestJSON-146039362-project-member] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 916.365849] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 916.366631] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.366855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.366987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.367522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.367752] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.367940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.368072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.368412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.368556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.368693] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.705700] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.871659] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.871921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.872028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.872288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.872385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.872607] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.872708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.872766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.872947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.873051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.873144] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be updated. [ 916.899494] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.899705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.899794] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.900375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.900375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.909821] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 916.938256] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.938490] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.938617] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.938927] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.941605] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.941787] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.942013] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.942542] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.943680] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.943680] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.943680] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.943680] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.943680] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.943680] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.943680] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.943680] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.968067] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.968067] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 916.968067] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.968490] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.968872] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-4b2d3909-ff28-4e2e-a94c-26243c335b7a taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.969162] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-4b2d3909-ff28-4e2e-a94c-26243c335b7a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.969276] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-4b2d3909-ff28-4e2e-a94c-26243c335b7a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.969772] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-4b2d3909-ff28-4e2e-a94c-26243c335b7a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.969945] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b2d3909-ff28-4e2e-a94c-26243c335b7a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.208965] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.473614] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.473957] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.474070] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.474373] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.474531] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.474730] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 4b2d3909-ff28-4e2e-a94c-26243c335b7a not found, creating... [ 917.475090] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.475424] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.475642] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.475926] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.476118] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.476455] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.476658] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.476765] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.477077] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.477257] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.477425] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 4b2d3909-ff28-4e2e-a94c-26243c335b7a is going to be created. [ 917.495832] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.496104] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.496263] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.496532] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.496777] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.497068] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-4b2d3909-ff28-4e2e-a94c-26243c335b7a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.666440] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce in Status: SUCCESS [ 917.666701] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.715494] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.715695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.715741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.715989] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.716120] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.716222] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 is going to be updated. [ 917.741832] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.742055] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.742144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.742349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.743361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.751816] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: IN_PROGRESS for 2s [ 918.426926] env[69499]: INFO networking_nsxv3.common.synchronization [req-d6043758-6dd9-420f-8fe7-97425dda8342 req-eb82f190-0286-472e-bf4e-909d9e6cd00d service nova] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_rules [ 918.426926] env[69499]: INFO networking_nsxv3.common.synchronization [req-d6043758-6dd9-420f-8fe7-97425dda8342 req-eb82f190-0286-472e-bf4e-909d9e6cd00d service nova] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 918.426926] env[69499]: INFO networking_nsxv3.common.synchronization [req-d6043758-6dd9-420f-8fe7-97425dda8342 req-eb82f190-0286-472e-bf4e-909d9e6cd00d service nova] Enqueued Resource ID: 4b2d3909-ff28-4e2e-a94c-26243c335b7a with Priority: HIGHEST for action port [ 918.426926] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_rules [ 918.426926] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 918.426926] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b2d3909-ff28-4e2e-a94c-26243c335b7a with Priority: HIGHEST for action port [ 918.426926] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.426926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.427383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.427383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.427383] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.428151] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.428257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.428444] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b2d3909-ff28-4e2e-a94c-26243c335b7a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.428573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b2d3909-ff28-4e2e-a94c-26243c335b7a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.428633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b2d3909-ff28-4e2e-a94c-26243c335b7a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.428868] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b2d3909-ff28-4e2e-a94c-26243c335b7a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.429016] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b2d3909-ff28-4e2e-a94c-26243c335b7a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.606810] env[69499]: INFO networking_nsxv3.common.synchronization [req-d06712cd-73c8-4987-85d1-177bea5cb572 req-80536a20-5181-4f64-9518-3979188d7f75 tempest-ImagesTestJSON-490670806 tempest-ImagesTestJSON-490670806-project-member] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 918.607400] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 918.607718] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.607845] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.607914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.608641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.609329] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.609713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.609713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.609713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.609843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.609890] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.668036] env[69499]: INFO networking_nsxv3.common.synchronization [req-00befe44-4c00-4c3c-bc1b-f4d10ba00f53 req-6c4a4ea7-ac97-4c1f-a53f-d1fc3e2f42a9 tempest-ListServerFiltersTestJSON-1505479587 tempest-ListServerFiltersTestJSON-1505479587-project-member] Enqueued Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 918.668036] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 918.668362] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.669032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.669032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.669268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.669268] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.669350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.669423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.670036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.670036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.670036] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.921810] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 918.921810] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 deletion is rescheduled due to dependency. [ 918.921810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.921810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.921810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.921810] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.921810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.921810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.921810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.921810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.921810] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.934021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.934021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.934021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b2d3909-ff28-4e2e-a94c-26243c335b7a with status ACTIVE [ 918.934021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.934021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.934021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.934021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.934021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.934021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.934021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.934021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.934021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.934021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.934021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.934666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.934666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.934666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.934666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.934666] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b2d3909-ff28-4e2e-a94c-26243c335b7a is going to be updated. [ 918.965070] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.965070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.965070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.965070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.965070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.965070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b2d3909-ff28-4e2e-a94c-26243c335b7a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.112031] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.112031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.112031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.112298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.112298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.112428] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.112537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.112603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.112758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.112843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.112927] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 919.130863] env[69499]: INFO networking_nsxv3.common.synchronization [req-925b721d-2e00-47e3-8d33-47e892ab395c req-244aa5cf-c578-4911-aec3-fa3bdecf48ec tempest-ServerAddressesTestJSON-1248476104 tempest-ServerAddressesTestJSON-1248476104-project-member] Enqueued Resource ID: f909dc53-3f94-4644-a89e-154a39dd9695 with Priority: HIGHEST for action security_group_members [ 919.131014] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f909dc53-3f94-4644-a89e-154a39dd9695 with Priority: HIGHEST for action security_group_members [ 919.131489] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f909dc53-3f94-4644-a89e-154a39dd9695 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.131489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.131489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.131777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.131966] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.132066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.132137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.135728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.135728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.135728] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f909dc53-3f94-4644-a89e-154a39dd9695',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.141473] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.143218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.143218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.143218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.143218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.151369] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 919.175947] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.423559] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.636490] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.636490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.636490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.636490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.636490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.636490] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.636490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.636490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.636490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.636490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.636490] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f909dc53-3f94-4644-a89e-154a39dd9695 already deleted. [ 919.636490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.678729] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.761220] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: SUCCESS [ 919.761714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.761714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.761846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.762019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.762138] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.762207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.762405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.762517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.762611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.762719] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.800545] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-850 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.800545] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-850" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.800545] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-850" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.801638] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-850" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.801951] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.802138] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.804989] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.804989] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.804989] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.804989] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 919.804989] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 919.804989] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 919.804989] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 919.804989] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 919.804989] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 919.804989] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 919.820787] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 919.820982] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 919.821210] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 919.821351] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-850" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.822348] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-73842b13-3456-45bb-b43d-b1f3f051d9a3 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.822348] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-73842b13-3456-45bb-b43d-b1f3f051d9a3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.822348] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-73842b13-3456-45bb-b43d-b1f3f051d9a3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.822348] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-73842b13-3456-45bb-b43d-b1f3f051d9a3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.822568] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73842b13-3456-45bb-b43d-b1f3f051d9a3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.825268] env[69499]: INFO networking_nsxv3.common.synchronization [req-89003e8b-41be-4b11-8338-9041f6419785 req-ca5df05c-c8fc-4d2e-9c29-7e8a86a4355f tempest-MigrationsAdminTest-725814107 tempest-MigrationsAdminTest-725814107-project-member] Enqueued Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_members [ 919.825345] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGHEST for action security_group_members [ 919.826055] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.826177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.826243] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.826428] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.826763] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.826763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.826763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.826929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.826994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.827100] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.925402] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.183023] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.183282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.183282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.183478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.183569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.183667] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 is going to be updated. [ 920.219221] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.219368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.219423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.219650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.219825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.232019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: IN_PROGRESS for 2s [ 920.269800] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.269800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.270079] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.270124] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.270284] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.270391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.270456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.270614] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.270724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.270787] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.270935] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.271038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.271151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.271313] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.271455] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.271546] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.271606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.271743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.271835] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.271932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.272035] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.326045] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.326045] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.326246] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.326473] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.326583] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.326804] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 73842b13-3456-45bb-b43d-b1f3f051d9a3 not found, creating... [ 920.327117] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.327262] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.327392] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.327626] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.327773] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.328088] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.328251] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.328372] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.328595] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.328789] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.328973] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 73842b13-3456-45bb-b43d-b1f3f051d9a3 is going to be created. [ 920.330293] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.330478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.330613] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.330836] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.330943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.331307] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.331441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.331524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.331708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.331796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.331902] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c is going to be updated. [ 920.356959] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.357297] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.357416] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.357764] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.358059] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.360073] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-73842b13-3456-45bb-b43d-b1f3f051d9a3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.364903] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.364903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.364903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.364903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.365169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.373882] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: IN_PROGRESS for 2s [ 920.428159] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.428347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.428423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.428681] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.428839] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.428962] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be updated. [ 920.469646] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.469823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.469898] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.470132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.470278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.478924] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 920.773991] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13d987c8-57de-4cf5-acd3-eb580bd10337: rpc.has_security_group_logging(os_id): False [ 920.791484] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.791649] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.791720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.791952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.792067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.792302] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.792404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.792468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.792623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.792698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.792876] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.792969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.793059] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.793185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.793259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.793441] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.793533] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.793592] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.793734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.793809] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.793894] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 is going to be updated. [ 920.882553] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.882707] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.882791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.884707] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.884707] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.898671] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: IN_PROGRESS for 2s [ 921.139212] env[69499]: INFO networking_nsxv3.common.synchronization [req-925b721d-2e00-47e3-8d33-47e892ab395c req-58521bb5-f00d-41b9-9b9f-954b2415f2a7 service nova] Enqueued Resource ID: f909dc53-3f94-4644-a89e-154a39dd9695 with Priority: HIGHEST for action security_group_rules [ 921.139387] env[69499]: INFO networking_nsxv3.common.synchronization [req-925b721d-2e00-47e3-8d33-47e892ab395c req-58521bb5-f00d-41b9-9b9f-954b2415f2a7 service nova] Enqueued Resource ID: f909dc53-3f94-4644-a89e-154a39dd9695 with Priority: HIGHEST for action security_group_members [ 921.139527] env[69499]: INFO networking_nsxv3.common.synchronization [req-925b721d-2e00-47e3-8d33-47e892ab395c req-58521bb5-f00d-41b9-9b9f-954b2415f2a7 service nova] Enqueued Resource ID: 73842b13-3456-45bb-b43d-b1f3f051d9a3 with Priority: HIGHEST for action port [ 921.139782] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f909dc53-3f94-4644-a89e-154a39dd9695 with Priority: HIGHEST for action security_group_rules [ 921.139926] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f909dc53-3f94-4644-a89e-154a39dd9695 with Priority: HIGHEST for action security_group_members [ 921.140044] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73842b13-3456-45bb-b43d-b1f3f051d9a3 with Priority: HIGHEST for action port [ 921.140610] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f909dc53-3f94-4644-a89e-154a39dd9695 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.140738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.140808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.141103] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.141189] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f909dc53-3f94-4644-a89e-154a39dd9695',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.142429] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f909dc53-3f94-4644-a89e-154a39dd9695 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.142547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.142613] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.142793] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.142940] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.143072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.143165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.143317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.143398] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.143517] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f909dc53-3f94-4644-a89e-154a39dd9695',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.144865] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-73842b13-3456-45bb-b43d-b1f3f051d9a3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.144865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73842b13-3456-45bb-b43d-b1f3f051d9a3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.144865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73842b13-3456-45bb-b43d-b1f3f051d9a3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.145014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73842b13-3456-45bb-b43d-b1f3f051d9a3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.145632] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73842b13-3456-45bb-b43d-b1f3f051d9a3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.163380] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 921.163566] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de deletion is rescheduled due to dependency. [ 921.163683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.643081] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f909dc53-3f94-4644-a89e-154a39dd9695 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.643241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.645535] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f909dc53-3f94-4644-a89e-154a39dd9695',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.648296] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73842b13-3456-45bb-b43d-b1f3f051d9a3 with status ACTIVE [ 921.648532] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.648675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.648817] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.649043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.649205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.649376] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.649456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.649516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.649681] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.649773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.649951] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.650074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.650112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.650371] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.650668] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.650668] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73842b13-3456-45bb-b43d-b1f3f051d9a3 is going to be updated. [ 921.672065] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.672253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.672299] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.672506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.672643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.672795] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73842b13-3456-45bb-b43d-b1f3f051d9a3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.148491] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f909dc53-3f94-4644-a89e-154a39dd9695',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.242609] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: SUCCESS [ 922.242843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.383265] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c in Status: SUCCESS [ 922.383519] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c deletion is rescheduled due to dependency. [ 922.383703] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.488083] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 922.488303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.488462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.488676] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.488945] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.489097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.489136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.489283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.489362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.489448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.489541] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.651252] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.651414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.651414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.651600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.651691] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.651786] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f909dc53-3f94-4644-a89e-154a39dd9695 is going to be created. [ 922.674361] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.674522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.674594] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.674798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.674959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.683410] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f909dc53-3f94-4644-a89e-154a39dd9695 in Status: UNINITIALIZED for 2s [ 922.884093] env[69499]: INFO networking_nsxv3.common.synchronization [req-26f94192-a020-44cc-8e13-7e48c6974776 req-05278ab1-75e4-4dda-9755-fa2614c4eaf6 tempest-ServersAdminTestJSON-2112223204 tempest-ServersAdminTestJSON-2112223204-project-member] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 922.884093] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 922.884093] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.884093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.884093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.884093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.884093] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.884594] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.884808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.885093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.885319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.887064] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.909192] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: SUCCESS [ 922.910356] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.992440] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.992746] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.992947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.993308] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.993633] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.993891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.994046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.994364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.994622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.994800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.995080] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.995292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.995418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.996363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.996363] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.996363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.996363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.996363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.996363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.996575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.996634] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.391504] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.499831] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31a7bec7-75f3-4780-ac90-0f2f7e7744e9: rpc.has_security_group_logging(os_id): False [ 923.517873] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.518032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.518097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.518319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.518408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.518621] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.518721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.518824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.518998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.519093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.519284] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.519377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.519438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.519579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.519652] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.519829] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.519991] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.519991] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.523285] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.523404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.523504] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be updated. [ 923.590849] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.591530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.591530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.591530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.591530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.617827] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 923.894153] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.400444] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.400769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.400769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.400932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.400986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.401129] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be updated. [ 924.431353] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.431538] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.431588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.431758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.431947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.440191] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 924.693120] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f909dc53-3f94-4644-a89e-154a39dd9695 in Status: SUCCESS [ 924.693331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.693756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.693973] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.694274] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.694391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.694459] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.694620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.694700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.694785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.694874] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f909dc53-3f94-4644-a89e-154a39dd9695',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.200565] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f909dc53-3f94-4644-a89e-154a39dd9695 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.201086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.201086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.201173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.201316] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.201499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.201499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.201872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.201872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.201872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.202169] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f909dc53-3f94-4644-a89e-154a39dd9695 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.202279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.202279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.202444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.202633] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.202734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.202797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.202964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.203130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.203204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.203319] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f909dc53-3f94-4644-a89e-154a39dd9695',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.238658] env[69499]: INFO networking_nsxv3.common.synchronization [req-ede2578c-6ecf-413d-ab3a-ebfa0cd37963 req-b1f73ef9-4851-4db4-9da9-4145ccdb836e tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f with Priority: HIGHEST for action security_group_members [ 925.240110] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f with Priority: HIGHEST for action security_group_members [ 925.243509] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-29ac832b-134e-49c9-ac8a-2171fbc0640f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.243509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.243722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.243866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.244057] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.244166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.244233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.244395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.244478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.244576] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29ac832b-134e-49c9-ac8a-2171fbc0640f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.591262] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.591262] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.591262] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.591262] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.591262] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.591262] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.591262] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.591262] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.591262] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.593680] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.593802] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.593921] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.594052] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.594169] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.594280] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.594421] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.612564] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.612764] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 925.612921] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.613129] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.613554] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-3e12ccf7-0e48-429c-958c-8df489366e1c taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.613751] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-3e12ccf7-0e48-429c-958c-8df489366e1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.613934] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-3e12ccf7-0e48-429c-958c-8df489366e1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.614320] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-3e12ccf7-0e48-429c-958c-8df489366e1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.614468] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e12ccf7-0e48-429c-958c-8df489366e1c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.632188] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 925.632685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.709217] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f909dc53-3f94-4644-a89e-154a39dd9695: rpc.has_security_group_logging(os_id): False [ 925.724719] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.724853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.724940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.725206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.725317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.725536] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.725641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.725694] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.725850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.725934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.726135] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.726230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.726290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.726429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.726503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.726686] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.726790] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.726868] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.729404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.729570] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.729682] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f909dc53-3f94-4644-a89e-154a39dd9695 is going to be created. [ 925.747830] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.748027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.748097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.748324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.748417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.748618] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.748819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.748819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.748959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.749056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.749303] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f already deleted. [ 925.749303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.794095] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.794291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.794332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.794550] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.794735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.806823] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f909dc53-3f94-4644-a89e-154a39dd9695 in Status: IN_PROGRESS for 2s [ 926.120305] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.120305] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.120305] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.120599] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.120599] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.120659] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 3e12ccf7-0e48-429c-958c-8df489366e1c not found, creating... [ 926.120873] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.121038] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.121158] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.121378] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.121509] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.121796] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.121950] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.122205] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.122438] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.122606] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.123109] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 3e12ccf7-0e48-429c-958c-8df489366e1c is going to be created. [ 926.142376] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.142603] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.142741] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.143054] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.143281] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.143510] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-3e12ccf7-0e48-429c-958c-8df489366e1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.452949] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 926.453191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.936555] env[69499]: INFO networking_nsxv3.common.synchronization [req-ede2578c-6ecf-413d-ab3a-ebfa0cd37963 req-8ca8e588-5100-4aa5-9d04-642f1e22d22f service nova] Enqueued Resource ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f with Priority: HIGHEST for action security_group_rules [ 926.936831] env[69499]: INFO networking_nsxv3.common.synchronization [req-ede2578c-6ecf-413d-ab3a-ebfa0cd37963 req-8ca8e588-5100-4aa5-9d04-642f1e22d22f service nova] Enqueued Resource ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f with Priority: HIGHEST for action security_group_members [ 926.937206] env[69499]: INFO networking_nsxv3.common.synchronization [req-ede2578c-6ecf-413d-ab3a-ebfa0cd37963 req-8ca8e588-5100-4aa5-9d04-642f1e22d22f service nova] Enqueued Resource ID: 3e12ccf7-0e48-429c-958c-8df489366e1c with Priority: HIGHEST for action port [ 926.937843] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f with Priority: HIGHEST for action security_group_rules [ 926.938091] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f with Priority: HIGHEST for action security_group_members [ 926.941733] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e12ccf7-0e48-429c-958c-8df489366e1c with Priority: HIGHEST for action port [ 926.942168] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29ac832b-134e-49c9-ac8a-2171fbc0640f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.942270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.942270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.942472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.942553] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29ac832b-134e-49c9-ac8a-2171fbc0640f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.946166] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-29ac832b-134e-49c9-ac8a-2171fbc0640f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.946166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.946166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.946166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.946166] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.946166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.946166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.946166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.946166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.946166] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29ac832b-134e-49c9-ac8a-2171fbc0640f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.946166] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e12ccf7-0e48-429c-958c-8df489366e1c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.946638] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e12ccf7-0e48-429c-958c-8df489366e1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.946638] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e12ccf7-0e48-429c-958c-8df489366e1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.946638] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e12ccf7-0e48-429c-958c-8df489366e1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.946638] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e12ccf7-0e48-429c-958c-8df489366e1c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.993393] env[69499]: INFO networking_nsxv3.common.synchronization [req-1f0733dc-37f3-4717-90f1-117a2fc4eb42 req-b2ebd13e-e7d7-4ed3-8947-0bd6c5416b86 tempest-ImagesOneServerNegativeTestJSON-1949881093 tempest-ImagesOneServerNegativeTestJSON-1949881093-project-member] Enqueued Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 926.993976] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 with Priority: HIGHEST for action security_group_members [ 926.994467] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d987c8-57de-4cf5-acd3-eb580bd10337 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.994467] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.994589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.994694] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.994862] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.994950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.995150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.995322] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.995416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.995514] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13d987c8-57de-4cf5-acd3-eb580bd10337',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.448892] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29ac832b-134e-49c9-ac8a-2171fbc0640f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.449430] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-29ac832b-134e-49c9-ac8a-2171fbc0640f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.449546] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.449705] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e12ccf7-0e48-429c-958c-8df489366e1c with status ACTIVE [ 927.449868] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.449994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.450073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.450276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.450408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.450525] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.450618] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.450716] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.450820] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.450895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.451094] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.451170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.451234] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.451374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.451448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.451531] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e12ccf7-0e48-429c-958c-8df489366e1c is going to be updated. [ 927.472291] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.472291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.472291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.472486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.472894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.472894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e12ccf7-0e48-429c-958c-8df489366e1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.499171] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.499171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.499171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.499171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.499171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.499171] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.499171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.499171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.499171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.499171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.499573] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 is going to be updated. [ 927.527220] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.527220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.527220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.527220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.527220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.536611] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: IN_PROGRESS for 2s [ 927.686156] env[69499]: INFO networking_nsxv3.common.synchronization [req-537f5c72-06cf-4b58-aab9-c9382c1206cf req-4e95e313-1840-4770-903e-cc42ccfc9b24 tempest-AttachVolumeTestJSON-2079313698 tempest-AttachVolumeTestJSON-2079313698-project-member] Enqueued Resource ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 with Priority: HIGHEST for action security_group_members [ 927.686773] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 with Priority: HIGHEST for action security_group_members [ 927.687141] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7f6a50-148b-4bd4-8db5-07c132b22182 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.687339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.687339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.687571] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.687996] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.687996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.687996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.688391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.688391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.688391] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7f6a50-148b-4bd4-8db5-07c132b22182',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.821938] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f909dc53-3f94-4644-a89e-154a39dd9695 in Status: SUCCESS [ 927.822149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.953268] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29ac832b-134e-49c9-ac8a-2171fbc0640f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.163442] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.163630] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-786" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.163756] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-786" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.164434] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-786" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.164742] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.164915] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.165047] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.165316] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.165467] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.165672] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.165787] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.165897] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.169023] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.169023] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.169023] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.169023] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.184332] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.184556] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 928.184684] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.186021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-786" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.186838] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-f861d847-170c-4cc1-b32f-f4a0323aaf13 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.186838] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-f861d847-170c-4cc1-b32f-f4a0323aaf13" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.187509] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-f861d847-170c-4cc1-b32f-f4a0323aaf13" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.187509] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-f861d847-170c-4cc1-b32f-f4a0323aaf13" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.187509] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f861d847-170c-4cc1-b32f-f4a0323aaf13',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.191233] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.191233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.191233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.191233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.191233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.191516] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.191516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.191623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.191702] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.191771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.191858] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 already deleted. [ 928.191971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.456245] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.456439] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.456501] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.457076] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.457190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.457312] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f is going to be created. [ 928.482199] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.482199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.482199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.482199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.482199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.490267] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f in Status: UNINITIALIZED for 2s [ 928.690055] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.690411] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.690616] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.690942] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.691150] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.691314] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port f861d847-170c-4cc1-b32f-f4a0323aaf13 not found, creating... [ 928.691629] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.691888] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.692011] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.692765] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.692765] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.692765] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.692964] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.693101] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.693419] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.693620] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.693818] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: f861d847-170c-4cc1-b32f-f4a0323aaf13 is going to be created. [ 928.714084] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.714267] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.714410] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.714690] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.714926] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.715162] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-f861d847-170c-4cc1-b32f-f4a0323aaf13" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.471962] env[69499]: INFO networking_nsxv3.common.synchronization [req-537f5c72-06cf-4b58-aab9-c9382c1206cf req-caa9e7d2-dc39-491b-b930-68588ce201b2 service nova] Enqueued Resource ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 with Priority: HIGHEST for action security_group_rules [ 929.473083] env[69499]: INFO networking_nsxv3.common.synchronization [req-537f5c72-06cf-4b58-aab9-c9382c1206cf req-caa9e7d2-dc39-491b-b930-68588ce201b2 service nova] Enqueued Resource ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 with Priority: HIGHEST for action security_group_members [ 929.473083] env[69499]: INFO networking_nsxv3.common.synchronization [req-537f5c72-06cf-4b58-aab9-c9382c1206cf req-caa9e7d2-dc39-491b-b930-68588ce201b2 service nova] Enqueued Resource ID: f861d847-170c-4cc1-b32f-f4a0323aaf13 with Priority: HIGHEST for action port [ 929.473083] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 with Priority: HIGHEST for action security_group_rules [ 929.473083] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 with Priority: HIGHEST for action security_group_members [ 929.473083] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f861d847-170c-4cc1-b32f-f4a0323aaf13 with Priority: HIGHEST for action port [ 929.473316] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a7f6a50-148b-4bd4-8db5-07c132b22182 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.473444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.473513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.473711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.473791] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a7f6a50-148b-4bd4-8db5-07c132b22182',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.475855] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7f6a50-148b-4bd4-8db5-07c132b22182 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.475976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.476059] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.476233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.476568] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.476645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.476645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.476827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.476924] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.480156] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7f6a50-148b-4bd4-8db5-07c132b22182',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.480939] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-f861d847-170c-4cc1-b32f-f4a0323aaf13 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.483154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f861d847-170c-4cc1-b32f-f4a0323aaf13" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.483154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f861d847-170c-4cc1-b32f-f4a0323aaf13" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.483154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f861d847-170c-4cc1-b32f-f4a0323aaf13" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.483154] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f861d847-170c-4cc1-b32f-f4a0323aaf13',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.547612] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 in Status: SUCCESS [ 929.547795] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d987c8-57de-4cf5-acd3-eb580bd10337 deletion is rescheduled due to dependency. [ 929.547909] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d987c8-57de-4cf5-acd3-eb580bd10337" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.985041] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7f6a50-148b-4bd4-8db5-07c132b22182 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.985041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.985041] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a7f6a50-148b-4bd4-8db5-07c132b22182',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.985884] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f861d847-170c-4cc1-b32f-f4a0323aaf13 with status ACTIVE [ 929.986112] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.986271] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.986318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.986565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.986663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.986887] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.986994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.987084] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.987255] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.987358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.987559] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.987660] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.987734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.987893] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.987977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.989160] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f861d847-170c-4cc1-b32f-f4a0323aaf13 is going to be updated. [ 930.009488] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.009649] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.009736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.010231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.010231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.010359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f861d847-170c-4cc1-b32f-f4a0323aaf13" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.436115] env[69499]: INFO networking_nsxv3.common.synchronization [req-ae777873-5735-4d48-8fc8-7180a9f9fda4 req-8be69493-b6c0-4621-a043-b408e38ac3b7 tempest-InstanceActionsV221TestJSON-740156474 tempest-InstanceActionsV221TestJSON-740156474-project-member] Enqueued Resource ID: 9e2f7750-c289-4805-83a2-f0930a638e2e with Priority: HIGHEST for action security_group_members [ 930.436660] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2f7750-c289-4805-83a2-f0930a638e2e with Priority: HIGHEST for action security_group_members [ 930.437051] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e2f7750-c289-4805-83a2-f0930a638e2e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.437197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.437287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.437557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.437715] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.437815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.437877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.438266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.438355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.438446] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e2f7750-c289-4805-83a2-f0930a638e2e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.492791] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a7f6a50-148b-4bd4-8db5-07c132b22182',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.501276] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f in Status: SUCCESS [ 930.505840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.505840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.505840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.505840] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.505840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.505840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.505840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.505840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.505840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.505840] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29ac832b-134e-49c9-ac8a-2171fbc0640f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.778986] env[69499]: INFO networking_nsxv3.common.synchronization [None req-e7ca5c02-cb26-44c2-9ce6-f4f4d75ac65b None None] Enqueued Resource ID: e4dad087-27ee-4f85-90be-90946093e5c2 with Priority: HIGHEST for action port [ 930.778986] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4dad087-27ee-4f85-90be-90946093e5c2 with Priority: HIGHEST for action port [ 930.779442] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4dad087-27ee-4f85-90be-90946093e5c2 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.779715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4dad087-27ee-4f85-90be-90946093e5c2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.782268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4dad087-27ee-4f85-90be-90946093e5c2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.782268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4dad087-27ee-4f85-90be-90946093e5c2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.782268] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4dad087-27ee-4f85-90be-90946093e5c2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.942695] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.942695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.942695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.942695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.942695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.942695] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.942695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.942695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.942695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.942695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.942695] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e2f7750-c289-4805-83a2-f0930a638e2e already deleted. [ 930.942695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.994725] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.994963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.995087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.995284] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.995374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.995526] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 is going to be created. [ 931.007889] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29ac832b-134e-49c9-ac8a-2171fbc0640f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.025448] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.025715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.025838] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.026225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.026816] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.049114] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 in Status: UNINITIALIZED for 2s [ 931.225179] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-157 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.225429] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.225630] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.225923] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.226409] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.226622] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.226774] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.227055] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.227224] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.227467] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.227588] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.227711] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.227820] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.227932] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.228061] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.228217] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.250477] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.250477] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 931.250477] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.250477] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-157" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.250477] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-63e00be1-1f4b-4bf1-ab4d-a8beea62d61a taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.250815] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-63e00be1-1f4b-4bf1-ab4d-a8beea62d61a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.250815] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-63e00be1-1f4b-4bf1-ab4d-a8beea62d61a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.253419] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-63e00be1-1f4b-4bf1-ab4d-a8beea62d61a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.253419] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63e00be1-1f4b-4bf1-ab4d-a8beea62d61a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.290314] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4dad087-27ee-4f85-90be-90946093e5c2 [ 931.290314] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.290314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.290314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.290314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.290314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.290314] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4dad087-27ee-4f85-90be-90946093e5c2 already deleted. [ 931.290314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4dad087-27ee-4f85-90be-90946093e5c2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.511831] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29ac832b-134e-49c9-ac8a-2171fbc0640f: rpc.has_security_group_logging(os_id): False [ 931.530391] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.530645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.530791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.531134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.531297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.531627] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.531775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.531861] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.532322] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.532468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.532591] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f is going to be created. [ 931.589367] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.589367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.589367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.590849] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.590849] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.603037] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f in Status: IN_PROGRESS for 2s [ 931.756691] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.756691] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.756691] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.757136] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.757247] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.757413] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 63e00be1-1f4b-4bf1-ab4d-a8beea62d61a not found, creating... [ 931.758184] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.758184] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.758184] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.758369] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.758369] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.758639] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.758876] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.758978] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.759215] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.759352] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.759496] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 63e00be1-1f4b-4bf1-ab4d-a8beea62d61a is going to be created. [ 931.780186] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.780413] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.780537] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.780826] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.781073] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.781405] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-63e00be1-1f4b-4bf1-ab4d-a8beea62d61a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.504568] env[69499]: INFO networking_nsxv3.common.synchronization [req-f1754f00-f9bb-485e-beeb-0b8da789f66b req-3e418827-d890-4c85-8777-ae01d70f17ba tempest-ServerAddressesTestJSON-1248476104 tempest-ServerAddressesTestJSON-1248476104-project-member] Enqueued Resource ID: f909dc53-3f94-4644-a89e-154a39dd9695 with Priority: HIGHEST for action security_group_members [ 932.509030] env[69499]: INFO networking_nsxv3.common.synchronization [req-e9998497-b7d5-4577-a743-2eed48ed8285 req-2bdbe8f7-ab71-4272-9aa0-a812d366caf5 tempest-AttachVolumeShelveTestJSON-1831532901 tempest-AttachVolumeShelveTestJSON-1831532901-project-member] Enqueued Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_members [ 932.509030] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f909dc53-3f94-4644-a89e-154a39dd9695 with Priority: HIGHEST for action security_group_members [ 932.509030] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGHEST for action security_group_members [ 932.509030] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-f909dc53-3f94-4644-a89e-154a39dd9695 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.509030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.509030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.509030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.509030] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.509030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.509030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.509030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.509030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.509030] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f909dc53-3f94-4644-a89e-154a39dd9695',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.509576] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8593ab1f-869e-4abc-aa58-bb57de585b7e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.509958] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.509958] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.510124] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.510124] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.510216] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.510273] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.510408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.510485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.510593] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.620134] env[69499]: INFO networking_nsxv3.common.synchronization [req-ae777873-5735-4d48-8fc8-7180a9f9fda4 req-92615d4c-4d02-4e20-9163-6c096c5ead02 service nova] Enqueued Resource ID: 9e2f7750-c289-4805-83a2-f0930a638e2e with Priority: HIGHEST for action security_group_rules [ 932.620511] env[69499]: INFO networking_nsxv3.common.synchronization [req-ae777873-5735-4d48-8fc8-7180a9f9fda4 req-92615d4c-4d02-4e20-9163-6c096c5ead02 service nova] Enqueued Resource ID: 9e2f7750-c289-4805-83a2-f0930a638e2e with Priority: HIGHEST for action security_group_members [ 932.620511] env[69499]: INFO networking_nsxv3.common.synchronization [req-ae777873-5735-4d48-8fc8-7180a9f9fda4 req-92615d4c-4d02-4e20-9163-6c096c5ead02 service nova] Enqueued Resource ID: 63e00be1-1f4b-4bf1-ab4d-a8beea62d61a with Priority: HIGHEST for action port [ 932.621084] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2f7750-c289-4805-83a2-f0930a638e2e with Priority: HIGHEST for action security_group_rules [ 932.621427] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2f7750-c289-4805-83a2-f0930a638e2e with Priority: HIGHEST for action security_group_members [ 932.621567] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63e00be1-1f4b-4bf1-ab4d-a8beea62d61a with Priority: HIGHEST for action port [ 932.621884] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e2f7750-c289-4805-83a2-f0930a638e2e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.622051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.622142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.622481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.622695] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e2f7750-c289-4805-83a2-f0930a638e2e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.625701] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e2f7750-c289-4805-83a2-f0930a638e2e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.625886] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.626451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.626706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.628215] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.628345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.628413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.628591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.628679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.628775] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e2f7750-c289-4805-83a2-f0930a638e2e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.631240] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-63e00be1-1f4b-4bf1-ab4d-a8beea62d61a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.634237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63e00be1-1f4b-4bf1-ab4d-a8beea62d61a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.634352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63e00be1-1f4b-4bf1-ab4d-a8beea62d61a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.634622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63e00be1-1f4b-4bf1-ab4d-a8beea62d61a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.634737] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63e00be1-1f4b-4bf1-ab4d-a8beea62d61a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.010238] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.010548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.010548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.010858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.010858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.011151] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.011151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.011329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.011465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.011529] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.011588] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f909dc53-3f94-4644-a89e-154a39dd9695 is going to be updated. [ 933.013390] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.013543] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.013601] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.014057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.014057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.014057] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.014930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.014930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.014930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.014930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.014930] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e is going to be updated. [ 933.037818] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.037916] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.037953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.038181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.038321] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.042722] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.042722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.042722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.042862] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.043013] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.075330] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e in Status: IN_PROGRESS for 2s [ 933.076038] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f909dc53-3f94-4644-a89e-154a39dd9695 in Status: IN_PROGRESS for 2s [ 933.077460] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 in Status: SUCCESS [ 933.078146] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.078253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.078514] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.078705] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.081627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.081627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.081627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.081627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.081627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.081627] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a7f6a50-148b-4bd4-8db5-07c132b22182',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.126012] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e2f7750-c289-4805-83a2-f0930a638e2e taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.126139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.132141] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e2f7750-c289-4805-83a2-f0930a638e2e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.136371] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63e00be1-1f4b-4bf1-ab4d-a8beea62d61a with status ACTIVE [ 933.136689] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.136885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.136964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.137244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.137316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.137481] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.137582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.137648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.137820] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.137890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.138069] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.138162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.138399] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.138399] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.138517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.138517] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63e00be1-1f4b-4bf1-ab4d-a8beea62d61a is going to be updated. [ 933.171972] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.172151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.172238] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.172430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.172569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.172720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63e00be1-1f4b-4bf1-ab4d-a8beea62d61a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.213356] env[69499]: INFO networking_nsxv3.common.synchronization [req-b0d6e79a-5df8-4a46-a614-e881a35bebc1 req-5a1abc8d-3390-4812-8449-861fb70b4d93 tempest-ServersTestBootFromVolume-649135408 tempest-ServersTestBootFromVolume-649135408-project-member] Enqueued Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGHEST for action security_group_members [ 933.213631] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGHEST for action security_group_members [ 933.215111] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd1b70ed-24ca-4742-b6ba-0af6127fef74 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.215237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.215304] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.215560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.215716] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.215814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.215878] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.216491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.216613] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.216714] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd1b70ed-24ca-4742-b6ba-0af6127fef74',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.501382] env[69499]: INFO networking_nsxv3.common.synchronization [None req-9c26c2b6-b15f-41ce-b074-d83928574848 None None] Enqueued Resource ID: 9eb82554-2552-4638-898a-2c7569524f05 with Priority: HIGHEST for action port [ 933.501382] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb82554-2552-4638-898a-2c7569524f05 with Priority: HIGHEST for action port [ 933.501706] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-9eb82554-2552-4638-898a-2c7569524f05 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.501824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9eb82554-2552-4638-898a-2c7569524f05" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.501824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9eb82554-2552-4638-898a-2c7569524f05" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.503764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9eb82554-2552-4638-898a-2c7569524f05" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.503878] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9eb82554-2552-4638-898a-2c7569524f05',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.581843] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a7f6a50-148b-4bd4-8db5-07c132b22182',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.613333] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f in Status: SUCCESS [ 933.613555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.637418] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e2f7750-c289-4805-83a2-f0930a638e2e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.720570] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.720724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.720799] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.721046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.721150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.721383] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.721487] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.721552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.721721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.721800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.722038] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 already deleted. [ 933.722038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.745437] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-60 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.746180] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.746180] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.746513] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.746800] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.747021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.747199] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.747481] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.748121] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.748121] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.748121] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 933.748121] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 933.748334] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 933.748489] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.748600] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 933.748740] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 933.770430] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 933.771072] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 933.771072] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 933.771072] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-60" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.771359] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-32e6df20-abe3-4e77-8deb-63a71c38211b taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.771637] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-32e6df20-abe3-4e77-8deb-63a71c38211b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.771678] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-32e6df20-abe3-4e77-8deb-63a71c38211b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.772020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-32e6df20-abe3-4e77-8deb-63a71c38211b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.772184] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32e6df20-abe3-4e77-8deb-63a71c38211b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.005915] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9eb82554-2552-4638-898a-2c7569524f05 [ 934.006234] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.006385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.006464] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.006928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.007174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.007289] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9eb82554-2552-4638-898a-2c7569524f05 already deleted. [ 934.007494] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9eb82554-2552-4638-898a-2c7569524f05" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.085717] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a7f6a50-148b-4bd4-8db5-07c132b22182: rpc.has_security_group_logging(os_id): False [ 934.103146] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.103389] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.103467] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.103668] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.103780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.104059] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.104167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.104233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.104392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.104471] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.104564] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 is going to be created. [ 934.139580] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.139729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.139802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.140100] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.140250] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.140393] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e2f7750-c289-4805-83a2-f0930a638e2e is going to be created. [ 934.160909] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.161073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.161152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.161430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.161626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.163237] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.163348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.163416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.163579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.163711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.170913] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e2f7750-c289-4805-83a2-f0930a638e2e in Status: UNINITIALIZED for 2s [ 934.172959] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 in Status: IN_PROGRESS for 2s [ 934.274718] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.274718] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.274891] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.275198] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.275374] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.275538] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 32e6df20-abe3-4e77-8deb-63a71c38211b not found, creating... [ 934.275801] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.275969] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.276104] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.276332] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.276473] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.276758] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.276915] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.277104] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.277329] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.277471] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.277614] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 32e6df20-abe3-4e77-8deb-63a71c38211b is going to be created. [ 934.306545] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.306795] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.306941] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.307252] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.307610] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.307713] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-32e6df20-abe3-4e77-8deb-63a71c38211b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.090717] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f909dc53-3f94-4644-a89e-154a39dd9695 in Status: SUCCESS [ 935.090717] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f909dc53-3f94-4644-a89e-154a39dd9695 deletion is rescheduled due to dependency. [ 935.090717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f909dc53-3f94-4644-a89e-154a39dd9695" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.090717] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e in Status: SUCCESS [ 935.090717] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e deletion is rescheduled due to dependency. [ 935.090717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.501479] env[69499]: INFO networking_nsxv3.common.synchronization [req-b0d6e79a-5df8-4a46-a614-e881a35bebc1 req-3bd37041-c8f6-4b1c-8a9b-022a57db3c50 service nova] Enqueued Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGHEST for action security_group_rules [ 935.501666] env[69499]: INFO networking_nsxv3.common.synchronization [req-b0d6e79a-5df8-4a46-a614-e881a35bebc1 req-3bd37041-c8f6-4b1c-8a9b-022a57db3c50 service nova] Enqueued Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGHEST for action security_group_members [ 935.501809] env[69499]: INFO networking_nsxv3.common.synchronization [req-b0d6e79a-5df8-4a46-a614-e881a35bebc1 req-3bd37041-c8f6-4b1c-8a9b-022a57db3c50 service nova] Enqueued Resource ID: 32e6df20-abe3-4e77-8deb-63a71c38211b with Priority: HIGHEST for action port [ 935.502329] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGHEST for action security_group_rules [ 935.502482] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGHEST for action security_group_members [ 935.502690] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e6df20-abe3-4e77-8deb-63a71c38211b with Priority: HIGHEST for action port [ 935.504041] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.507037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.507037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.507220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.507301] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd1b70ed-24ca-4742-b6ba-0af6127fef74',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.508244] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd1b70ed-24ca-4742-b6ba-0af6127fef74 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.508367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.508439] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.508624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.508798] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.508889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.508964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.509130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.509215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.509309] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd1b70ed-24ca-4742-b6ba-0af6127fef74',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.510146] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-32e6df20-abe3-4e77-8deb-63a71c38211b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.510268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32e6df20-abe3-4e77-8deb-63a71c38211b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.510328] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32e6df20-abe3-4e77-8deb-63a71c38211b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.510468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32e6df20-abe3-4e77-8deb-63a71c38211b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.510544] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32e6df20-abe3-4e77-8deb-63a71c38211b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.012013] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd1b70ed-24ca-4742-b6ba-0af6127fef74 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.013331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.013331] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd1b70ed-24ca-4742-b6ba-0af6127fef74',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.014064] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32e6df20-abe3-4e77-8deb-63a71c38211b with status ACTIVE [ 936.014064] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.014217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.014217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.015731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.015731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.015731] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.015731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.015731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.016057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.016057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.016112] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.016302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.016302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.016411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.016458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.016537] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32e6df20-abe3-4e77-8deb-63a71c38211b is going to be updated. [ 936.035979] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.036169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.036248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.036503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.036644] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.036823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32e6df20-abe3-4e77-8deb-63a71c38211b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.181704] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e2f7750-c289-4805-83a2-f0930a638e2e in Status: SUCCESS [ 936.182213] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.182213] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.182364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.182648] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.182794] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.182876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.183092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.183228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.183343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.183486] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e2f7750-c289-4805-83a2-f0930a638e2e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.187024] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 in Status: SUCCESS [ 936.187024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.519272] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd1b70ed-24ca-4742-b6ba-0af6127fef74',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.689017] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e2f7750-c289-4805-83a2-f0930a638e2e taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.689209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.689285] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.689505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.689684] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.689785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.689922] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.689989] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.690125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.690186] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.690328] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e2f7750-c289-4805-83a2-f0930a638e2e taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.690415] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.690480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.690631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.690768] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.690947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.691032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.691206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.691306] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.691390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.691478] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e2f7750-c289-4805-83a2-f0930a638e2e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.024199] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.024199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.024199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.024199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.024199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.024199] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 is going to be created. [ 937.048171] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.048171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.048171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.048171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.048171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.055480] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 in Status: UNINITIALIZED for 2s [ 937.193257] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e2f7750-c289-4805-83a2-f0930a638e2e: rpc.has_security_group_logging(os_id): False [ 937.216205] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.216297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.219358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.219358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.219358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.219358] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.219358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.219358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.219358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.219358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.219358] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.219358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.219358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.219358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.219358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.219358] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.220167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.220167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.220167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.220167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.220167] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e2f7750-c289-4805-83a2-f0930a638e2e is going to be created. [ 937.297788] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.300018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.300018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.300018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.300018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.310437] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e2f7750-c289-4805-83a2-f0930a638e2e in Status: IN_PROGRESS for 2s [ 937.939855] env[69499]: INFO networking_nsxv3.common.synchronization [req-9730bf6a-76bc-4ad0-914c-076865543ad3 req-e587fa36-a080-4918-a71e-bddf989fcea3 tempest-ImagesTestJSON-490670806 tempest-ImagesTestJSON-490670806-project-member] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 937.940428] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 937.940813] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.940813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.941022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.941234] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.941406] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.941508] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.941967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.941967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.941967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.941967] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.032828] env[69499]: INFO networking_nsxv3.common.synchronization [None req-0f690cce-8e50-4ddf-89b2-e4ed0ea82663 None None] Enqueued Resource ID: 5395a735-3705-4814-b55f-4f1d8e027921 with Priority: HIGHEST for action port [ 938.033121] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5395a735-3705-4814-b55f-4f1d8e027921 with Priority: HIGHEST for action port [ 938.033691] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-5395a735-3705-4814-b55f-4f1d8e027921 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.033821] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5395a735-3705-4814-b55f-4f1d8e027921" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.033892] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5395a735-3705-4814-b55f-4f1d8e027921" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.034432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5395a735-3705-4814-b55f-4f1d8e027921" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.034518] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5395a735-3705-4814-b55f-4f1d8e027921',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.444824] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.445167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.445167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.445341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.445445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.445631] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.445744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.445824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.446061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.446189] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.446289] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 938.471886] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.471982] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.472054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.472335] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.472523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.484602] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 938.536662] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5395a735-3705-4814-b55f-4f1d8e027921 [ 938.536899] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.537053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.537125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.537339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.537530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.537635] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5395a735-3705-4814-b55f-4f1d8e027921 already deleted. [ 938.537722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5395a735-3705-4814-b55f-4f1d8e027921" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.599739] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.599957] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.600124] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.600421] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.603735] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.603985] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.604148] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.604395] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.604542] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.604814] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.604946] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.605293] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.606109] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.606109] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.606109] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.606109] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.627037] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.627281] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 938.627548] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.627847] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-350" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.628398] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-ac8ff593-5f88-4bb1-9dc9-967d0caa1deb taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.628645] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-ac8ff593-5f88-4bb1-9dc9-967d0caa1deb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.628774] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-ac8ff593-5f88-4bb1-9dc9-967d0caa1deb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.629150] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-ac8ff593-5f88-4bb1-9dc9-967d0caa1deb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.629294] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac8ff593-5f88-4bb1-9dc9-967d0caa1deb',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.916512] env[69499]: INFO networking_nsxv3.common.synchronization [None req-4d5b61d8-26db-42af-a24e-8a44e07e73b6 tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGHEST for action security_group_rules [ 938.917098] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGHEST for action security_group_rules [ 938.917415] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.918529] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.918529] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.918529] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.918529] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b5ab2a6-a426-4cab-ae0e-330b8062bbf5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.057139] env[69499]: INFO networking_nsxv3.common.synchronization [None req-5ba26cca-a596-44c3-b183-4c72214cda37 tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGHEST for action security_group_rules [ 939.061931] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGHEST for action security_group_rules [ 939.061931] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.061931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.069244] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 in Status: SUCCESS [ 939.069834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.069997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.070596] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.071205] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.072402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.072402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.072402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.072402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.072402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.072402] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd1b70ed-24ca-4742-b6ba-0af6127fef74',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.136098] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.136098] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.136098] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.136098] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.136098] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.136098] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port ac8ff593-5f88-4bb1-9dc9-967d0caa1deb not found, creating... [ 939.136098] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.136098] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.136098] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.136098] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.136098] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.136884] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.136884] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.136884] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.136884] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.136884] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.136884] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: ac8ff593-5f88-4bb1-9dc9-967d0caa1deb is going to be created. [ 939.157016] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.157016] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.157016] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.157016] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.157016] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.157016] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-ac8ff593-5f88-4bb1-9dc9-967d0caa1deb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.331915] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e2f7750-c289-4805-83a2-f0930a638e2e in Status: SUCCESS [ 939.332377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.442736] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.443015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.443015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.444450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.444450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.444450] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 already deleted. [ 939.444450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.444450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.444450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.444450] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b5ab2a6-a426-4cab-ae0e-330b8062bbf5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.574934] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd1b70ed-24ca-4742-b6ba-0af6127fef74',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.971172] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.971342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.971997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.971997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.971997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.971997] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 already deleted. [ 939.971997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.080437] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd1b70ed-24ca-4742-b6ba-0af6127fef74: rpc.has_security_group_logging(os_id): False [ 940.101177] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.101346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.101385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.101596] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.101683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.102136] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.102136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.102136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.102288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.102631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.102631] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 is going to be created. [ 940.150946] env[69499]: INFO networking_nsxv3.common.synchronization [req-9730bf6a-76bc-4ad0-914c-076865543ad3 req-798fdeaa-a24c-4fdd-86c1-a0dd4aceb21d service nova] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_rules [ 940.151579] env[69499]: INFO networking_nsxv3.common.synchronization [req-9730bf6a-76bc-4ad0-914c-076865543ad3 req-798fdeaa-a24c-4fdd-86c1-a0dd4aceb21d service nova] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 940.152134] env[69499]: INFO networking_nsxv3.common.synchronization [req-9730bf6a-76bc-4ad0-914c-076865543ad3 req-798fdeaa-a24c-4fdd-86c1-a0dd4aceb21d service nova] Enqueued Resource ID: ac8ff593-5f88-4bb1-9dc9-967d0caa1deb with Priority: HIGHEST for action port [ 940.153387] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_rules [ 940.153387] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 940.153387] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac8ff593-5f88-4bb1-9dc9-967d0caa1deb with Priority: HIGHEST for action port [ 940.153387] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.153591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.153591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.153966] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.153966] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.154694] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.154785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.154989] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac8ff593-5f88-4bb1-9dc9-967d0caa1deb taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.155095] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac8ff593-5f88-4bb1-9dc9-967d0caa1deb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.155157] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac8ff593-5f88-4bb1-9dc9-967d0caa1deb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.155557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac8ff593-5f88-4bb1-9dc9-967d0caa1deb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.155654] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac8ff593-5f88-4bb1-9dc9-967d0caa1deb',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.192763] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.192882] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.192882] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.194402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.194402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.223025] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 in Status: IN_PROGRESS for 2s [ 940.505107] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 940.505519] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de deletion is rescheduled due to dependency. [ 940.505711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.505996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.506248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.506435] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.506554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.506611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.506917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.506917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.507143] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.658516] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.658644] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.658836] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac8ff593-5f88-4bb1-9dc9-967d0caa1deb with status ACTIVE [ 940.659050] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.659197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.659230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.659418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.659542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.660204] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.660314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.660380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.660552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.660638] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.662019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.662994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.663076] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.663250] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.663333] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.663424] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac8ff593-5f88-4bb1-9dc9-967d0caa1deb is going to be updated. [ 940.688990] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.690281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.690281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.690281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.690281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.690281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac8ff593-5f88-4bb1-9dc9-967d0caa1deb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.915515] env[69499]: INFO networking_nsxv3.common.synchronization [None req-04c79721-bcdc-4baf-a01c-7f2932f8190e None None] Enqueued Resource ID: 92002d03-9f05-418a-b32d-b8bf8b518797 with Priority: HIGHEST for action port [ 940.916325] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92002d03-9f05-418a-b32d-b8bf8b518797 with Priority: HIGHEST for action port [ 940.916753] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-92002d03-9f05-418a-b32d-b8bf8b518797 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.917017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92002d03-9f05-418a-b32d-b8bf8b518797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.917167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92002d03-9f05-418a-b32d-b8bf8b518797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.918024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92002d03-9f05-418a-b32d-b8bf8b518797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.918236] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92002d03-9f05-418a-b32d-b8bf8b518797',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.009482] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.422161] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92002d03-9f05-418a-b32d-b8bf8b518797 [ 941.422410] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.422549] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.422620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.422842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.422935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.423045] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92002d03-9f05-418a-b32d-b8bf8b518797 already deleted. [ 941.423132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92002d03-9f05-418a-b32d-b8bf8b518797" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.512975] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.016946] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.016946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.016946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.016946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.016946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.016946] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 942.055505] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.055751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.056214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.056458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.060023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.065128] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 942.234267] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 in Status: SUCCESS [ 942.234496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.092784] env[69499]: INFO networking_nsxv3.common.synchronization [None req-848f3d7e-d8b7-42d6-9213-d11f261064a4 None None] Enqueued Resource ID: c46f9d73-12b1-4202-b8d6-fe7caf22ac80 with Priority: HIGHEST for action port [ 943.092784] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c46f9d73-12b1-4202-b8d6-fe7caf22ac80 with Priority: HIGHEST for action port [ 943.092784] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-c46f9d73-12b1-4202-b8d6-fe7caf22ac80 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.092784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c46f9d73-12b1-4202-b8d6-fe7caf22ac80" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.093441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c46f9d73-12b1-4202-b8d6-fe7caf22ac80" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.093441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c46f9d73-12b1-4202-b8d6-fe7caf22ac80" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.093441] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c46f9d73-12b1-4202-b8d6-fe7caf22ac80',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.596484] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c46f9d73-12b1-4202-b8d6-fe7caf22ac80 [ 943.596725] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.596867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.596937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.597193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.597298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.597401] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c46f9d73-12b1-4202-b8d6-fe7caf22ac80 already deleted. [ 943.597483] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c46f9d73-12b1-4202-b8d6-fe7caf22ac80" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.622894] env[69499]: INFO networking_nsxv3.common.synchronization [req-c5bf91ab-b6cc-464c-9a70-27ba1ca1679d req-af2e5163-70f9-4f26-801a-f4e43297b4ee tempest-InstanceActionsV221TestJSON-740156474 tempest-InstanceActionsV221TestJSON-740156474-project-member] Enqueued Resource ID: 9e2f7750-c289-4805-83a2-f0930a638e2e with Priority: HIGHEST for action security_group_members [ 943.622894] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2f7750-c289-4805-83a2-f0930a638e2e with Priority: HIGHEST for action security_group_members [ 943.622894] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e2f7750-c289-4805-83a2-f0930a638e2e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.622894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.623669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.624069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.624718] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.625411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.625411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.626093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.626093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.626093] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e2f7750-c289-4805-83a2-f0930a638e2e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.901908] env[69499]: INFO networking_nsxv3.common.synchronization [None req-5743c309-0fb2-4d84-a580-86a835fbd945 tempest-ServersTestManualDisk-216863239 tempest-ServersTestManualDisk-216863239-project-member] Enqueued Resource ID: 11b16049-e77a-4319-a5c3-228658ee669e with Priority: HIGHEST for action security_group_rules [ 943.902814] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11b16049-e77a-4319-a5c3-228658ee669e with Priority: HIGHEST for action security_group_rules [ 943.903428] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11b16049-e77a-4319-a5c3-228658ee669e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.903502] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.903573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.903825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.903913] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11b16049-e77a-4319-a5c3-228658ee669e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.036816] env[69499]: INFO networking_nsxv3.common.synchronization [None req-364b836a-aacb-4f8d-b429-08c9f5c88ae4 tempest-ServersTestManualDisk-216863239 tempest-ServersTestManualDisk-216863239-project-member] Enqueued Resource ID: 11b16049-e77a-4319-a5c3-228658ee669e with Priority: HIGHEST for action security_group_rules [ 944.037561] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11b16049-e77a-4319-a5c3-228658ee669e with Priority: HIGHEST for action security_group_rules [ 944.038126] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11b16049-e77a-4319-a5c3-228658ee669e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.038360] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.075450] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 944.075683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.075846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.076105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.076313] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.076421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.076494] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.076654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.076736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.076820] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.076924] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.128608] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.128959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.128959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.131015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.131015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.131015] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.131015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.131015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.131015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.131015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.131015] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e2f7750-c289-4805-83a2-f0930a638e2e is going to be updated. [ 944.159756] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.159756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.159876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.159998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.160159] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.169030] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e2f7750-c289-4805-83a2-f0930a638e2e in Status: IN_PROGRESS for 2s [ 944.351822] env[69499]: INFO networking_nsxv3.common.synchronization [req-68c9d737-c23d-4b41-a24a-5e74b876f5fd req-561ac602-6acc-4ce7-8017-fc7f5b9b6118 tempest-ListServerFiltersTestJSON-1505479587 tempest-ListServerFiltersTestJSON-1505479587-project-member] Enqueued Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 944.352479] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 944.352836] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.352997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.353940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.354193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.354371] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.354495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.354558] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.358806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.358806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.358806] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.426819] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.426819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.426819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.426819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.426819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.426819] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11b16049-e77a-4319-a5c3-228658ee669e already deleted. [ 944.426819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.426819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.426819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.426819] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11b16049-e77a-4319-a5c3-228658ee669e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.581034] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.581034] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.581034] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.581597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.581917] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.582046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.582164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.582396] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.582831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.582992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.583231] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.583393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.583496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.583694] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.583902] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.584185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.584323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.584515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.584644] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.584773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.584904] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.863211] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.947727] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.947890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.947962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.948256] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.948535] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.948535] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11b16049-e77a-4319-a5c3-228658ee669e already deleted. [ 944.948637] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.087601] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 137495f6-8f3c-475d-b71c-88971c3781de: rpc.has_security_group_logging(os_id): False [ 945.106063] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.107375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.107375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.107375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.107375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.107375] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.107375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.107375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.107375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.107717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.107717] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.107717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.107823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.107948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.108022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.108184] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.108282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.108452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.108517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.108580] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.108630] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 945.241803] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.242114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.242114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.242263] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.242342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.261287] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 945.365866] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.798134] env[69499]: INFO networking_nsxv3.common.synchronization [None req-2230f5af-0c8c-47db-9469-2472227f31a0 None None] Enqueued Resource ID: e00c6e32-ba59-48bb-a553-93359b662f4d with Priority: HIGHEST for action port [ 945.798134] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e00c6e32-ba59-48bb-a553-93359b662f4d with Priority: HIGHEST for action port [ 945.799416] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e00c6e32-ba59-48bb-a553-93359b662f4d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.799579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e00c6e32-ba59-48bb-a553-93359b662f4d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.799640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e00c6e32-ba59-48bb-a553-93359b662f4d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.800622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e00c6e32-ba59-48bb-a553-93359b662f4d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.800747] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e00c6e32-ba59-48bb-a553-93359b662f4d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.871360] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.872557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.872557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.872557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.872765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.872765] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 is going to be updated. [ 945.911266] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.911462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.911513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.911705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.912128] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.923954] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: IN_PROGRESS for 2s [ 946.183709] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e2f7750-c289-4805-83a2-f0930a638e2e in Status: SUCCESS [ 946.183902] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e2f7750-c289-4805-83a2-f0930a638e2e deletion is rescheduled due to dependency. [ 946.184025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.303460] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e00c6e32-ba59-48bb-a553-93359b662f4d [ 946.304011] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.304500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.304883] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.305256] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.305517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.305681] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e00c6e32-ba59-48bb-a553-93359b662f4d already deleted. [ 946.306188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e00c6e32-ba59-48bb-a553-93359b662f4d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.074037] env[69499]: INFO networking_nsxv3.common.synchronization [None req-3aa9b8d4-0d55-4eea-8903-1e233a465b3b None None] Enqueued Resource ID: d56ad075-8ac3-4e34-a83e-b926d848189b with Priority: HIGHEST for action port [ 947.074693] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d56ad075-8ac3-4e34-a83e-b926d848189b with Priority: HIGHEST for action port [ 947.075231] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-d56ad075-8ac3-4e34-a83e-b926d848189b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.075231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d56ad075-8ac3-4e34-a83e-b926d848189b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.079265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d56ad075-8ac3-4e34-a83e-b926d848189b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.079486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d56ad075-8ac3-4e34-a83e-b926d848189b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.079595] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d56ad075-8ac3-4e34-a83e-b926d848189b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.276910] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 947.277185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.588720] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d56ad075-8ac3-4e34-a83e-b926d848189b [ 947.588720] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.588720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.588720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.588720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.588720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.588720] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d56ad075-8ac3-4e34-a83e-b926d848189b already deleted. [ 947.588720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d56ad075-8ac3-4e34-a83e-b926d848189b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.934098] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: SUCCESS [ 947.934379] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.429843] env[69499]: INFO networking_nsxv3.common.synchronization [None req-00263358-0fb3-4b3c-8379-789cb717c660 None None] Enqueued Resource ID: de50afef-ca65-4eb8-95de-827b051f3c58 with Priority: HIGHEST for action port [ 949.430263] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de50afef-ca65-4eb8-95de-827b051f3c58 with Priority: HIGHEST for action port [ 949.432308] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-de50afef-ca65-4eb8-95de-827b051f3c58 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.432308] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de50afef-ca65-4eb8-95de-827b051f3c58" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.432308] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de50afef-ca65-4eb8-95de-827b051f3c58" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.432308] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de50afef-ca65-4eb8-95de-827b051f3c58" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.432308] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de50afef-ca65-4eb8-95de-827b051f3c58',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.590521] env[69499]: INFO networking_nsxv3.common.synchronization [req-033ceb20-9cf2-43f5-a2e5-23d4eb4afd8f req-586f6b30-41f7-43f8-aa71-b2bc2c024c89 tempest-ServersAdminTestJSON-2112223204 tempest-ServersAdminTestJSON-2112223204-project-member] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 949.591552] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGHEST for action security_group_members [ 949.591552] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.591765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.591765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.591932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.592482] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.592482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.592482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.592659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.592659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.592741] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.938578] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de50afef-ca65-4eb8-95de-827b051f3c58 [ 949.938825] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.938969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.939056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.939244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.939338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.939435] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de50afef-ca65-4eb8-95de-827b051f3c58 already deleted. [ 949.939519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de50afef-ca65-4eb8-95de-827b051f3c58" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.095865] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.096040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.096111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.096327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.096415] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.096610] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.096740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.096772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.096959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.097064] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.097102] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be updated. [ 950.125303] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.125455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.125519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.125736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.125877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.133537] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 2s [ 952.143569] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: IN_PROGRESS for 4s [ 954.154066] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 in Status: SUCCESS [ 954.154066] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 deletion is rescheduled due to dependency. [ 954.154428] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.593051] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 954.593120] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 955.009433] env[69499]: INFO networking_nsxv3.common.synchronization [req-927f6659-31da-42c3-b7af-179434666c1b req-0dd9815d-1a20-465e-928e-11e0168bde82 tempest-ServersWithSpecificFlavorTestJSON-328556625 tempest-ServersWithSpecificFlavorTestJSON-328556625-project-member] Enqueued Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_members [ 955.010126] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc with Priority: HIGHEST for action security_group_members [ 955.010478] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8579ac1e-c68a-42fa-957e-e205942d2fbc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.010601] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.010686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.010910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.016024] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.016024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.016024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.016024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.016024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.016024] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8579ac1e-c68a-42fa-957e-e205942d2fbc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.518246] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.518525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.518525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.518686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.545184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.545490] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.545593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.545631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.546529] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.546529] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.546529] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc is going to be updated. [ 955.571873] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.571997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.571997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.572207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.572345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.579832] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc in Status: IN_PROGRESS for 2s [ 956.056283] env[69499]: INFO networking_nsxv3.common.synchronization [None req-12843d8c-744b-4afb-85f2-75f3106047d5 None None] Enqueued Resource ID: 4d3ceb83-ab98-4508-9505-b55617563e73 with Priority: HIGHEST for action port [ 956.057656] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d3ceb83-ab98-4508-9505-b55617563e73 with Priority: HIGHEST for action port [ 956.057656] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d3ceb83-ab98-4508-9505-b55617563e73 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.057854] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d3ceb83-ab98-4508-9505-b55617563e73" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.057854] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d3ceb83-ab98-4508-9505-b55617563e73" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.058083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d3ceb83-ab98-4508-9505-b55617563e73" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.058175] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d3ceb83-ab98-4508-9505-b55617563e73',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.562127] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d3ceb83-ab98-4508-9505-b55617563e73 [ 956.562419] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.562669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.562703] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.563205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.563205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.563205] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d3ceb83-ab98-4508-9505-b55617563e73 already deleted. [ 956.563354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d3ceb83-ab98-4508-9505-b55617563e73" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.794083] env[69499]: INFO networking_nsxv3.common.synchronization [None req-de41414f-e96a-4ac0-a277-fab67fae0cfd tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 with Priority: HIGHEST for action security_group_rules [ 956.796573] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 with Priority: HIGHEST for action security_group_rules [ 956.796573] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.796573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.796573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.796573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.796573] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b269f87-89e9-484d-8baa-02ac9f5f2e89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.892077] env[69499]: INFO networking_nsxv3.common.synchronization [None req-99a44f64-648f-49c1-9b6b-3f0584b747d8 tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 with Priority: HIGHEST for action security_group_rules [ 956.892077] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 with Priority: HIGHEST for action security_group_rules [ 956.892077] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.892077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.315170] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.316303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.316456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.317053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.317053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.317053] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 already deleted. [ 957.317053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.317053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.317369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.317369] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b269f87-89e9-484d-8baa-02ac9f5f2e89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.588941] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc in Status: SUCCESS [ 957.589302] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8579ac1e-c68a-42fa-957e-e205942d2fbc deletion is rescheduled due to dependency. [ 957.590352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8579ac1e-c68a-42fa-957e-e205942d2fbc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.839956] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.839956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.839956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.839956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.839956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.839956] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 already deleted. [ 957.839956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.312511] env[69499]: INFO networking_nsxv3.common.synchronization [None req-baf460c5-8912-4660-bc2b-2af566e5945f None None] Enqueued Resource ID: b0a38935-e292-4385-8fe3-f39f43a2e3b4 with Priority: HIGHEST for action port [ 958.312511] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0a38935-e292-4385-8fe3-f39f43a2e3b4 with Priority: HIGHEST for action port [ 958.312696] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0a38935-e292-4385-8fe3-f39f43a2e3b4 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.312760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0a38935-e292-4385-8fe3-f39f43a2e3b4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.312760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0a38935-e292-4385-8fe3-f39f43a2e3b4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.313148] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0a38935-e292-4385-8fe3-f39f43a2e3b4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.313260] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0a38935-e292-4385-8fe3-f39f43a2e3b4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.797072] env[69499]: INFO networking_nsxv3.common.synchronization [None req-196d437e-cbce-4a89-b0c9-a73139999da5 tempest-AttachVolumeShelveTestJSON-1831532901 tempest-AttachVolumeShelveTestJSON-1831532901-project-member] Enqueued Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_rules [ 958.797825] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_rules [ 958.798119] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-547a2dde-952d-4847-b831-1393133e5c28 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.798247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.798316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.798568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.798655] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.814985] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0a38935-e292-4385-8fe3-f39f43a2e3b4 [ 958.815221] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.815355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.815424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.815630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.815720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.815842] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0a38935-e292-4385-8fe3-f39f43a2e3b4 already deleted. [ 958.815924] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0a38935-e292-4385-8fe3-f39f43a2e3b4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.881432] env[69499]: INFO networking_nsxv3.common.synchronization [None req-a220f167-937f-49e5-bdec-923a95f272fe tempest-AttachVolumeShelveTestJSON-1831532901 tempest-AttachVolumeShelveTestJSON-1831532901-project-member] Enqueued Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_rules [ 958.881966] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_rules [ 958.882282] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-547a2dde-952d-4847-b831-1393133e5c28 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.882388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.317978] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.318155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.318207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.318413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.318503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.318595] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 547a2dde-952d-4847-b831-1393133e5c28 already deleted. [ 959.318678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.318826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.318980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.319126] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.839301] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.839301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.839301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.839301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.839301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.839301] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 547a2dde-952d-4847-b831-1393133e5c28 already deleted. [ 959.839825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.051397] env[69499]: INFO networking_nsxv3.common.synchronization [req-52e5548d-2386-4075-b74a-22fe89b690fa req-16d123c9-f7c7-49b6-841a-d60d8f87199b tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGHEST for action security_group_members [ 960.051960] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGHEST for action security_group_members [ 960.052292] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.052444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.052514] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.052826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.052986] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.057046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.057146] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.057369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.057485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.057589] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b5ab2a6-a426-4cab-ae0e-330b8062bbf5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.371332] env[69499]: INFO networking_nsxv3.common.synchronization [req-c62cc2ef-edea-4d3b-ac95-d9f745957195 req-2b423b1f-4091-4975-a867-aafcf7fafd0b tempest-ImagesTestJSON-490670806 tempest-ImagesTestJSON-490670806-project-member] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 960.371949] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGHEST for action security_group_members [ 960.372146] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.372313] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.372432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.372692] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.373202] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.373202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.373202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.373380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.373543] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.373708] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.469768] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.469980] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.470125] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.470515] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.470802] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.470975] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.471114] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.471421] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.471591] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.471817] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.471949] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.472080] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.472198] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.472312] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.472435] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.472892] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.492443] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.492443] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 960.492443] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.492443] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.492443] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-49e538b9-323a-4c91-9735-2d2d0bbf15f1 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.492443] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-49e538b9-323a-4c91-9735-2d2d0bbf15f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.492443] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-49e538b9-323a-4c91-9735-2d2d0bbf15f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.492443] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-49e538b9-323a-4c91-9735-2d2d0bbf15f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.492443] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49e538b9-323a-4c91-9735-2d2d0bbf15f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.559771] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.559931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.560068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.560349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.560446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.560649] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.560801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.560901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.561187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.561187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.561281] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 already deleted. [ 960.561353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.876695] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.877064] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.877117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.877342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.877437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.877644] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.877743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.877806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.877962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.878049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.878139] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be updated. [ 960.917657] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.917800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.917800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.918199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.918199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.932873] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: IN_PROGRESS for 2s [ 960.995299] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.995515] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.995635] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.995941] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.996130] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.996390] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 49e538b9-323a-4c91-9735-2d2d0bbf15f1 not found, creating... [ 960.996558] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.996722] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.996892] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.997131] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.997288] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.997583] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.997741] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.997864] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.998107] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.998251] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.998395] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 49e538b9-323a-4c91-9735-2d2d0bbf15f1 is going to be created. [ 961.019399] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.019602] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.019732] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.020012] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.020286] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.020519] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-49e538b9-323a-4c91-9735-2d2d0bbf15f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.695127] env[69499]: INFO networking_nsxv3.common.synchronization [req-52e5548d-2386-4075-b74a-22fe89b690fa req-42b84bac-885d-4108-8ec5-8bc477d49f9f service nova] Enqueued Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGHEST for action security_group_rules [ 961.695127] env[69499]: INFO networking_nsxv3.common.synchronization [req-52e5548d-2386-4075-b74a-22fe89b690fa req-42b84bac-885d-4108-8ec5-8bc477d49f9f service nova] Enqueued Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGHEST for action security_group_members [ 961.695127] env[69499]: INFO networking_nsxv3.common.synchronization [req-52e5548d-2386-4075-b74a-22fe89b690fa req-42b84bac-885d-4108-8ec5-8bc477d49f9f service nova] Enqueued Resource ID: 49e538b9-323a-4c91-9735-2d2d0bbf15f1 with Priority: HIGHEST for action port [ 961.695127] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGHEST for action security_group_rules [ 961.695127] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGHEST for action security_group_members [ 961.695127] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e538b9-323a-4c91-9735-2d2d0bbf15f1 with Priority: HIGHEST for action port [ 961.696709] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.696987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.698029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.698029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.698029] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b5ab2a6-a426-4cab-ae0e-330b8062bbf5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.698997] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.699188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.699262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.699424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.699573] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.699668] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.699725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.700866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.700866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.700866] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b5ab2a6-a426-4cab-ae0e-330b8062bbf5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.700866] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-49e538b9-323a-4c91-9735-2d2d0bbf15f1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.701244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49e538b9-323a-4c91-9735-2d2d0bbf15f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.701244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49e538b9-323a-4c91-9735-2d2d0bbf15f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.701244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49e538b9-323a-4c91-9735-2d2d0bbf15f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.701244] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49e538b9-323a-4c91-9735-2d2d0bbf15f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.199635] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.200033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.203142] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b5ab2a6-a426-4cab-ae0e-330b8062bbf5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.204877] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49e538b9-323a-4c91-9735-2d2d0bbf15f1 with status ACTIVE [ 962.204877] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.204877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.204877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.205191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.205191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.205286] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.205357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.205357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.205518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.205586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.205768] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.205869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.205922] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.206051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.206116] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.206203] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49e538b9-323a-4c91-9735-2d2d0bbf15f1 is going to be updated. [ 962.228863] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.228863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.228863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.228863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.228863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.228863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49e538b9-323a-4c91-9735-2d2d0bbf15f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.708067] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b5ab2a6-a426-4cab-ae0e-330b8062bbf5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.945218] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137495f6-8f3c-475d-b71c-88971c3781de in Status: SUCCESS [ 962.945425] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137495f6-8f3c-475d-b71c-88971c3781de deletion is rescheduled due to dependency. [ 962.945544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.212836] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.212836] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.213230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.213230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.213230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.213433] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 is going to be created. [ 963.251495] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.251695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.251747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.251934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.252130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.263774] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 in Status: UNINITIALIZED for 2s [ 964.604110] env[69499]: INFO networking_nsxv3.common.synchronization [req-ae2aa708-1f51-4eaa-8313-83417aac6be5 req-331e6af4-cd5f-4cb9-8a57-f13ff93c9743 tempest-ServersV294TestFqdnHostnames-1817828186 tempest-ServersV294TestFqdnHostnames-1817828186-project-member] Enqueued Resource ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d with Priority: HIGHEST for action security_group_members [ 964.611329] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d with Priority: HIGHEST for action security_group_members [ 964.616156] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-68bf910a-7d9f-4466-9028-7ab38c7fc30d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.616317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.616384] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.616606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.616777] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.616872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.616934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.617114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.617197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.617295] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68bf910a-7d9f-4466-9028-7ab38c7fc30d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.120050] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.120303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.120303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.120548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.120649] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.120872] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.120976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.121193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.121269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.121309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.121420] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d is going to be updated. [ 965.149969] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.150271] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.150349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.150558] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.150697] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.158501] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d in Status: IN_PROGRESS for 2s [ 965.275468] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 in Status: SUCCESS [ 965.275468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.275468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.275468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.275468] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.275468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.275468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.275468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.275468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.275468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.275468] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b5ab2a6-a426-4cab-ae0e-330b8062bbf5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.776837] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b5ab2a6-a426-4cab-ae0e-330b8062bbf5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.279532] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5: rpc.has_security_group_logging(os_id): False [ 966.298420] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.298630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.298715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.298937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.299114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.299541] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.299865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.299865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.299979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.299979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.300114] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 is going to be created. [ 966.363259] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.363467] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.363891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.363891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.364433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.376841] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 in Status: IN_PROGRESS for 2s [ 966.451083] env[69499]: INFO networking_nsxv3.common.synchronization [req-4f406312-b912-4e18-ab2f-38c7424e2ace req-52d56b83-12f8-44c3-b57a-ca68ee74ef92 tempest-ServersTestManualDisk-216863239 tempest-ServersTestManualDisk-216863239-project-member] Enqueued Resource ID: 11b16049-e77a-4319-a5c3-228658ee669e with Priority: HIGHEST for action security_group_members [ 966.451648] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11b16049-e77a-4319-a5c3-228658ee669e with Priority: HIGHEST for action security_group_members [ 966.451947] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-11b16049-e77a-4319-a5c3-228658ee669e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.452113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.452150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.452414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.452928] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.453297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.453297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.453297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.453414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.453472] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11b16049-e77a-4319-a5c3-228658ee669e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.750715] env[69499]: INFO networking_nsxv3.common.synchronization [req-e01205d6-89ff-4e3a-afad-a4561543556f req-7d8340d1-7c97-46f2-99d6-2569df96b2ff tempest-ListServerFiltersTestJSON-1505479587 tempest-ListServerFiltersTestJSON-1505479587-project-member] Enqueued Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 966.751811] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 with Priority: HIGHEST for action security_group_members [ 966.751811] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-39342f68-f184-4c9d-a63b-6e7eb4959f38 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.751811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.751811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.752238] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.752591] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.752795] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.752904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.753228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.753323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.753616] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39342f68-f184-4c9d-a63b-6e7eb4959f38',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.853718] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-294 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.853718] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-294" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.853718] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-294" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.853718] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-294" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.854380] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.854380] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.854380] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.854380] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.854630] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.854668] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.854764] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.854867] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.854973] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.855096] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.855202] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.855335] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.873923] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.874192] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 966.874357] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.874504] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-294" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.874830] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-e6857121-1e02-4c0d-8e31-52eefddec317 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.875259] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-e6857121-1e02-4c0d-8e31-52eefddec317" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.875259] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-e6857121-1e02-4c0d-8e31-52eefddec317" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.875516] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-e6857121-1e02-4c0d-8e31-52eefddec317" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.875662] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6857121-1e02-4c0d-8e31-52eefddec317',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.956544] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.956723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.956791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.957021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.957123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.957334] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.957437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.957532] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.957729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.957855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.957958] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11b16049-e77a-4319-a5c3-228658ee669e already deleted. [ 966.958063] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.167364] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d in Status: SUCCESS [ 967.167536] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68bf910a-7d9f-4466-9028-7ab38c7fc30d deletion is rescheduled due to dependency. [ 967.167634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68bf910a-7d9f-4466-9028-7ab38c7fc30d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.255879] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.256115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.256224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.256514] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.256645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.256915] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.257085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.257180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.257401] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.257508] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.257624] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 is going to be updated. [ 967.284663] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.284838] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.284937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.285223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.285454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.293811] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: IN_PROGRESS for 2s [ 967.378817] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.379153] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.379362] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.379746] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.379973] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.380216] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port e6857121-1e02-4c0d-8e31-52eefddec317 not found, creating... [ 967.380596] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.380834] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.381026] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.381358] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.381572] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.381986] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.382233] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.382410] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.382713] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.382920] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.383147] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: e6857121-1e02-4c0d-8e31-52eefddec317 is going to be created. [ 967.402886] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.403239] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.403454] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.403857] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.404228] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.404586] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-e6857121-1e02-4c0d-8e31-52eefddec317" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.190300] env[69499]: INFO networking_nsxv3.common.synchronization [req-4f406312-b912-4e18-ab2f-38c7424e2ace req-dd1f15df-9a71-4a2b-85ab-ffef4d1d1abc service nova] Enqueued Resource ID: 11b16049-e77a-4319-a5c3-228658ee669e with Priority: HIGHEST for action security_group_rules [ 968.190613] env[69499]: INFO networking_nsxv3.common.synchronization [req-4f406312-b912-4e18-ab2f-38c7424e2ace req-dd1f15df-9a71-4a2b-85ab-ffef4d1d1abc service nova] Enqueued Resource ID: 11b16049-e77a-4319-a5c3-228658ee669e with Priority: HIGHEST for action security_group_members [ 968.190613] env[69499]: INFO networking_nsxv3.common.synchronization [req-4f406312-b912-4e18-ab2f-38c7424e2ace req-dd1f15df-9a71-4a2b-85ab-ffef4d1d1abc service nova] Enqueued Resource ID: e6857121-1e02-4c0d-8e31-52eefddec317 with Priority: HIGHEST for action port [ 968.191085] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11b16049-e77a-4319-a5c3-228658ee669e with Priority: HIGHEST for action security_group_rules [ 968.191085] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11b16049-e77a-4319-a5c3-228658ee669e with Priority: HIGHEST for action security_group_members [ 968.191085] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6857121-1e02-4c0d-8e31-52eefddec317 with Priority: HIGHEST for action port [ 968.191661] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11b16049-e77a-4319-a5c3-228658ee669e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.191792] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.191860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.192084] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.192169] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11b16049-e77a-4319-a5c3-228658ee669e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.193046] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-11b16049-e77a-4319-a5c3-228658ee669e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.193165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.193234] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.193405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.193555] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.193651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.193709] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.193850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.193934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.194035] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11b16049-e77a-4319-a5c3-228658ee669e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.195833] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6857121-1e02-4c0d-8e31-52eefddec317 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.195962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6857121-1e02-4c0d-8e31-52eefddec317" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.196031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6857121-1e02-4c0d-8e31-52eefddec317" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.196184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6857121-1e02-4c0d-8e31-52eefddec317" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.196260] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6857121-1e02-4c0d-8e31-52eefddec317',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.390112] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 in Status: SUCCESS [ 968.390390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.697792] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11b16049-e77a-4319-a5c3-228658ee669e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.699175] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-11b16049-e77a-4319-a5c3-228658ee669e taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.699321] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.700633] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6857121-1e02-4c0d-8e31-52eefddec317 with status ACTIVE [ 968.700818] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.700937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.701017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.701249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.701333] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.701573] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.701673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.701733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.701897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.701974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.702180] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.702270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.702329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.702468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.702541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.702621] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6857121-1e02-4c0d-8e31-52eefddec317 is going to be updated. [ 968.722208] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.722208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.722208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.722208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.722208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.722208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6857121-1e02-4c0d-8e31-52eefddec317" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.204863] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11b16049-e77a-4319-a5c3-228658ee669e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.303057] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 in Status: SUCCESS [ 969.303263] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39342f68-f184-4c9d-a63b-6e7eb4959f38 deletion is rescheduled due to dependency. [ 969.303379] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39342f68-f184-4c9d-a63b-6e7eb4959f38" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.707596] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.707850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.707962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.708388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.708559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.708749] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11b16049-e77a-4319-a5c3-228658ee669e is going to be created. [ 969.731140] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.731140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.731568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.731568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.731770] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.741657] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11b16049-e77a-4319-a5c3-228658ee669e in Status: UNINITIALIZED for 2s [ 971.754018] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11b16049-e77a-4319-a5c3-228658ee669e in Status: SUCCESS [ 971.754018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.754018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.754018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.754018] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.754018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.754018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.754018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.754018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.754018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.754018] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11b16049-e77a-4319-a5c3-228658ee669e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.256374] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11b16049-e77a-4319-a5c3-228658ee669e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.758198] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11b16049-e77a-4319-a5c3-228658ee669e: rpc.has_security_group_logging(os_id): False [ 972.776063] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.776328] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.776328] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.776554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.777885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.777885] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.777885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.777885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.778584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.778737] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.778864] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11b16049-e77a-4319-a5c3-228658ee669e is going to be created. [ 972.832361] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.832512] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.832569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.832791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.833075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.843782] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11b16049-e77a-4319-a5c3-228658ee669e in Status: IN_PROGRESS for 2s [ 973.193385] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 973.193522] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 974.857072] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11b16049-e77a-4319-a5c3-228658ee669e in Status: SUCCESS [ 974.857654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.109668] env[69499]: INFO networking_nsxv3.common.synchronization [None req-ada4df96-06e5-4595-9ad5-d16153b3d30a None None] Enqueued Resource ID: 53f6788e-895d-4ab1-9eaf-b722e60eab22 with Priority: HIGHEST for action port [ 975.110341] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53f6788e-895d-4ab1-9eaf-b722e60eab22 with Priority: HIGHEST for action port [ 975.110703] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-53f6788e-895d-4ab1-9eaf-b722e60eab22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.110846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53f6788e-895d-4ab1-9eaf-b722e60eab22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.110918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53f6788e-895d-4ab1-9eaf-b722e60eab22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.111667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53f6788e-895d-4ab1-9eaf-b722e60eab22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.111767] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53f6788e-895d-4ab1-9eaf-b722e60eab22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.617323] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53f6788e-895d-4ab1-9eaf-b722e60eab22 [ 975.617323] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.617323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.617530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.617574] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.617701] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.620019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53f6788e-895d-4ab1-9eaf-b722e60eab22 already deleted. [ 975.620019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53f6788e-895d-4ab1-9eaf-b722e60eab22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.679496] env[69499]: INFO networking_nsxv3.common.synchronization [req-e5cc9046-f512-4768-a96e-2a296e62049a req-aca5b369-6044-45a8-979d-49972be4ce29 tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 with Priority: HIGHEST for action security_group_members [ 976.680534] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 with Priority: HIGHEST for action security_group_members [ 976.682074] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b269f87-89e9-484d-8baa-02ac9f5f2e89 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.682262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.682788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.683152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.683255] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.683363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.683552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.683600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.683716] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.683782] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b269f87-89e9-484d-8baa-02ac9f5f2e89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.185880] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.185880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.185880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.186137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.186137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.186332] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.186435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.186486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.186636] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.186714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.186797] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 already deleted. [ 977.186875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.357195] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.357195] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.357195] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.357195] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.357446] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.357446] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.357562] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.357785] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.357930] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.358161] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 977.358274] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.358385] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.358494] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.358604] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 977.358709] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.358843] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.379597] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.379824] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 977.380266] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.380487] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.380828] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.381017] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.381158] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.381521] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.381672] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.888023] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.888023] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.888023] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.888023] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.888023] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.888023] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb not found, creating... [ 977.888023] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.888023] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.888023] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.888023] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.888023] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.888722] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.888722] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.888722] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.888722] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.889041] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.889408] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb is going to be created. [ 977.911177] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.911177] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.911177] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.911177] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.911177] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.911177] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.766042] env[69499]: INFO networking_nsxv3.common.synchronization [req-e5cc9046-f512-4768-a96e-2a296e62049a req-ba7fb79e-ed95-4ce4-aed6-753cfe5c0022 service nova] Enqueued Resource ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 with Priority: HIGHEST for action security_group_rules [ 978.766239] env[69499]: INFO networking_nsxv3.common.synchronization [req-e5cc9046-f512-4768-a96e-2a296e62049a req-ba7fb79e-ed95-4ce4-aed6-753cfe5c0022 service nova] Enqueued Resource ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 with Priority: HIGHEST for action security_group_members [ 978.766386] env[69499]: INFO networking_nsxv3.common.synchronization [req-e5cc9046-f512-4768-a96e-2a296e62049a req-ba7fb79e-ed95-4ce4-aed6-753cfe5c0022 service nova] Enqueued Resource ID: a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb with Priority: HIGHEST for action port [ 978.766626] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 with Priority: HIGHEST for action security_group_rules [ 978.766763] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 with Priority: HIGHEST for action security_group_members [ 978.766862] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb with Priority: HIGHEST for action port [ 978.768573] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.768728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.768851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.769146] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.769684] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b269f87-89e9-484d-8baa-02ac9f5f2e89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.772691] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b269f87-89e9-484d-8baa-02ac9f5f2e89 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.772851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.772947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.773183] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.773386] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.775170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.775273] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.776163] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.776163] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.776163] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b269f87-89e9-484d-8baa-02ac9f5f2e89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.776606] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.776749] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.776850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.777356] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.777356] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.222980] env[69499]: INFO networking_nsxv3.common.synchronization [req-eff3141a-e0d7-4151-adaf-6fa5bd1fdaed req-b064890e-76a7-472f-9b6f-aa5cb1c75bb1 tempest-AttachVolumeShelveTestJSON-1831532901 tempest-AttachVolumeShelveTestJSON-1831532901-project-member] Enqueued Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_members [ 979.223578] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_members [ 979.223897] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-547a2dde-952d-4847-b831-1393133e5c28 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.224167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.224167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.224359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.224527] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.224661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.224730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.224890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.224974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.225334] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.283478] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b269f87-89e9-484d-8baa-02ac9f5f2e89 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.283478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.283478] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b269f87-89e9-484d-8baa-02ac9f5f2e89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.283478] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb with status ACTIVE [ 979.283478] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.283478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.283478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.284065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.284414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.284937] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.285224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.285464] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.286183] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.286366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.286843] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.287201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.287503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.287726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.290114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.290114] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb is going to be updated. [ 979.308446] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.308446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.308446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.308446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.308446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.308446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4817b73-6b3f-4fdf-b4bb-d9b0ec5800eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.659018] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-490 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.659018] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.659018] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.659018] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.659018] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.659018] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.659018] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.660471] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.660772] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.661709] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.661984] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.662739] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.662991] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.663241] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.663942] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.665835] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.684123] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.684123] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 979.684123] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.684123] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.684123] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-7f6c6bbb-6309-427c-b851-62d5827c319f taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.684123] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.684123] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.684123] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.684123] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f6c6bbb-6309-427c-b851-62d5827c319f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.727453] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.727453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.727453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.727813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.727911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.728117] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.728301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.728301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.728423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.728500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.728584] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 547a2dde-952d-4847-b831-1393133e5c28 already deleted. [ 979.728663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.790293] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b269f87-89e9-484d-8baa-02ac9f5f2e89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.186798] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.187141] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.187336] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.187757] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.187946] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.188186] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 7f6c6bbb-6309-427c-b851-62d5827c319f not found, creating... [ 980.188574] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.188806] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.188981] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.193246] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.193483] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.194156] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.194253] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.194426] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.194657] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.194858] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.195400] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 7f6c6bbb-6309-427c-b851-62d5827c319f is going to be created. [ 980.220760] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.220991] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.221248] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.221566] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.221755] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.221987] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.293260] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.293552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.294880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.294880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.294880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.294880] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 is going to be created. [ 980.321438] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.321566] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.321692] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.322951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.322951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.341731] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 in Status: UNINITIALIZED for 2s [ 981.514277] env[69499]: INFO networking_nsxv3.common.synchronization [None req-2390e01a-a66e-4a12-bc57-de46344b2b51 None None] Enqueued Resource ID: 3c0bb399-5c9f-4c39-a5d3-5f3f11145e6c with Priority: HIGHEST for action port [ 981.514797] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c0bb399-5c9f-4c39-a5d3-5f3f11145e6c with Priority: HIGHEST for action port [ 981.515111] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c0bb399-5c9f-4c39-a5d3-5f3f11145e6c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.517032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c0bb399-5c9f-4c39-a5d3-5f3f11145e6c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.517032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c0bb399-5c9f-4c39-a5d3-5f3f11145e6c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.517726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c0bb399-5c9f-4c39-a5d3-5f3f11145e6c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.517726] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c0bb399-5c9f-4c39-a5d3-5f3f11145e6c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.593225] env[69499]: INFO networking_nsxv3.common.synchronization [req-eff3141a-e0d7-4151-adaf-6fa5bd1fdaed req-b3e749b6-5718-4077-9426-f684efd1f9bb service nova] Enqueued Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_rules [ 981.593412] env[69499]: INFO networking_nsxv3.common.synchronization [req-eff3141a-e0d7-4151-adaf-6fa5bd1fdaed req-b3e749b6-5718-4077-9426-f684efd1f9bb service nova] Enqueued Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_members [ 981.593556] env[69499]: INFO networking_nsxv3.common.synchronization [req-eff3141a-e0d7-4151-adaf-6fa5bd1fdaed req-b3e749b6-5718-4077-9426-f684efd1f9bb service nova] Enqueued Resource ID: 7f6c6bbb-6309-427c-b851-62d5827c319f with Priority: HIGHEST for action port [ 981.593783] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_rules [ 981.593913] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_members [ 981.594019] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6c6bbb-6309-427c-b851-62d5827c319f with Priority: HIGHEST for action port [ 981.594580] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-547a2dde-952d-4847-b831-1393133e5c28 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.594780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.594852] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.595074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.595157] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.596268] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-547a2dde-952d-4847-b831-1393133e5c28 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.596346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.596418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.596595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.596796] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.596841] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.596874] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.597093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.597230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.597282] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.597991] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f6c6bbb-6309-427c-b851-62d5827c319f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.598443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.598520] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.598674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.598749] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f6c6bbb-6309-427c-b851-62d5827c319f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.794045] env[69499]: INFO networking_nsxv3.common.synchronization [req-4d45bb89-5827-451c-922e-f350504ec5c6 req-67ab8aa6-dc95-4eb7-a7dd-7a648f7ab3fa tempest-ServerActionsV293TestJSON-1166940701 tempest-ServerActionsV293TestJSON-1166940701-project-member] Enqueued Resource ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f with Priority: HIGHEST for action security_group_members [ 981.794532] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f with Priority: HIGHEST for action security_group_members [ 981.794968] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-44133d71-0f30-4e7f-9c96-2491812bcd1f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.795383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.795383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.795383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.795537] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.795625] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.795684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.795826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.795917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.795988] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44133d71-0f30-4e7f-9c96-2491812bcd1f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.021218] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c0bb399-5c9f-4c39-a5d3-5f3f11145e6c [ 982.021509] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.021710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.021808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.022073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.022158] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.022233] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c0bb399-5c9f-4c39-a5d3-5f3f11145e6c already deleted. [ 982.022319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c0bb399-5c9f-4c39-a5d3-5f3f11145e6c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.103227] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f6c6bbb-6309-427c-b851-62d5827c319f with status ACTIVE [ 982.103227] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.103227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.103227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.103227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.103227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.103227] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.103227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.103227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.104171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.104171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.107311] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.107519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.107519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.107978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.107978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.107978] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f6c6bbb-6309-427c-b851-62d5827c319f is going to be updated. [ 982.109161] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-547a2dde-952d-4847-b831-1393133e5c28 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.109303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.109614] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.130320] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.130513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.130598] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.130812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.130969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.131146] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.301586] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.301586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.301586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.301586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.321610] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.321888] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.322035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.322110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.322325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.322421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.322497] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f is going to be updated. [ 982.350226] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.350226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.350226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.350226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.350226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.351538] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 in Status: SUCCESS [ 982.351834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.352085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.352249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.352427] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.352542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.352605] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.352762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.352843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.352928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.353029] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b269f87-89e9-484d-8baa-02ac9f5f2e89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.355410] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f in Status: IN_PROGRESS for 2s [ 982.615411] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.855240] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b269f87-89e9-484d-8baa-02ac9f5f2e89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.120432] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.120588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.120661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.120876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.120966] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.121076] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 547a2dde-952d-4847-b831-1393133e5c28 is going to be created. [ 983.143764] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.143913] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.143973] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.144223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.144879] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.154465] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 547a2dde-952d-4847-b831-1393133e5c28 in Status: UNINITIALIZED for 2s [ 983.358759] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b269f87-89e9-484d-8baa-02ac9f5f2e89: rpc.has_security_group_logging(os_id): False [ 983.382659] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.382659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.382659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.385745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.385745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.385745] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.385745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.385745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.385745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.385745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.385745] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 is going to be created. [ 983.452264] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.452264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.452264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.452264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.452264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.463684] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 in Status: IN_PROGRESS for 2s [ 984.141856] env[69499]: INFO networking_nsxv3.common.synchronization [None req-8185824e-cd13-45c0-baf8-c831e83c0c15 None None] Enqueued Resource ID: 3636d8c5-f515-4757-aa96-1902df082ca3 with Priority: HIGHEST for action port [ 984.142359] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3636d8c5-f515-4757-aa96-1902df082ca3 with Priority: HIGHEST for action port [ 984.142359] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-3636d8c5-f515-4757-aa96-1902df082ca3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.142359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3636d8c5-f515-4757-aa96-1902df082ca3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.142486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3636d8c5-f515-4757-aa96-1902df082ca3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.142666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3636d8c5-f515-4757-aa96-1902df082ca3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.142744] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3636d8c5-f515-4757-aa96-1902df082ca3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.364658] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f in Status: SUCCESS [ 984.364846] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44133d71-0f30-4e7f-9c96-2491812bcd1f deletion is rescheduled due to dependency. [ 984.364960] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44133d71-0f30-4e7f-9c96-2491812bcd1f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.649709] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3636d8c5-f515-4757-aa96-1902df082ca3 [ 984.651012] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.651012] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.651012] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.651012] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.651012] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.651363] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3636d8c5-f515-4757-aa96-1902df082ca3 already deleted. [ 984.651564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3636d8c5-f515-4757-aa96-1902df082ca3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.163951] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 547a2dde-952d-4847-b831-1393133e5c28 in Status: SUCCESS [ 985.163951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.163951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.163951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.163951] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.163951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.163951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.163951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.163951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.163951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.163951] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.477975] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 in Status: SUCCESS [ 985.477975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.667435] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.765253] env[69499]: INFO networking_nsxv3.common.synchronization [None req-4bbfe7eb-c082-4b3b-a8ec-fb85ccc4f28f None None] Enqueued Resource ID: 06511b14-c303-41c9-a3b5-ac093cdb889d with Priority: HIGHEST for action port [ 985.765946] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06511b14-c303-41c9-a3b5-ac093cdb889d with Priority: HIGHEST for action port [ 985.766326] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-06511b14-c303-41c9-a3b5-ac093cdb889d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.766467] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06511b14-c303-41c9-a3b5-ac093cdb889d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.766563] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06511b14-c303-41c9-a3b5-ac093cdb889d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.766872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06511b14-c303-41c9-a3b5-ac093cdb889d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.766975] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06511b14-c303-41c9-a3b5-ac093cdb889d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.174280] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 547a2dde-952d-4847-b831-1393133e5c28: rpc.has_security_group_logging(os_id): False [ 986.191058] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.191058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.191058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.191058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.191058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.191058] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.191058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.191058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.191695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.191695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.191848] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 547a2dde-952d-4847-b831-1393133e5c28 is going to be created. [ 986.246221] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.246352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.246352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.246822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.246822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.257700] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 547a2dde-952d-4847-b831-1393133e5c28 in Status: IN_PROGRESS for 2s [ 986.272604] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06511b14-c303-41c9-a3b5-ac093cdb889d [ 986.273621] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.273901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.274179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.274510] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.274845] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.275418] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06511b14-c303-41c9-a3b5-ac093cdb889d already deleted. [ 986.275964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06511b14-c303-41c9-a3b5-ac093cdb889d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.995383] env[69499]: INFO networking_nsxv3.common.synchronization [None req-9be55eb2-b57f-4a3b-9033-0c20d7adbe6c None None] Enqueued Resource ID: bcd046be-b151-4831-a535-eb2648237e8e with Priority: HIGHEST for action port [ 987.995796] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcd046be-b151-4831-a535-eb2648237e8e with Priority: HIGHEST for action port [ 987.996213] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcd046be-b151-4831-a535-eb2648237e8e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.997192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcd046be-b151-4831-a535-eb2648237e8e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.997317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcd046be-b151-4831-a535-eb2648237e8e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.997585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcd046be-b151-4831-a535-eb2648237e8e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.997675] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcd046be-b151-4831-a535-eb2648237e8e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.270012] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 547a2dde-952d-4847-b831-1393133e5c28 in Status: SUCCESS [ 988.270329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.501562] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bcd046be-b151-4831-a535-eb2648237e8e [ 988.501793] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.501934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.502083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.502260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.504536] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.504536] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bcd046be-b151-4831-a535-eb2648237e8e already deleted. [ 988.504536] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcd046be-b151-4831-a535-eb2648237e8e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.694068] env[69499]: INFO networking_nsxv3.common.synchronization [None req-a7e35c96-b8d4-49cd-b000-a279707f5683 None None] Enqueued Resource ID: 0fb72b46-15ac-40d6-9596-7b8a3021877f with Priority: HIGHEST for action port [ 989.694939] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fb72b46-15ac-40d6-9596-7b8a3021877f with Priority: HIGHEST for action port [ 989.695031] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fb72b46-15ac-40d6-9596-7b8a3021877f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.695286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fb72b46-15ac-40d6-9596-7b8a3021877f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.695455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fb72b46-15ac-40d6-9596-7b8a3021877f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.696210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fb72b46-15ac-40d6-9596-7b8a3021877f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.696393] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fb72b46-15ac-40d6-9596-7b8a3021877f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.778864] env[69499]: INFO networking_nsxv3.common.synchronization [None req-a09ea1e3-0f64-43e9-bda1-7cc33a4d945b tempest-ServerDiskConfigTestJSON-146039362 tempest-ServerDiskConfigTestJSON-146039362-project-member] Enqueued Resource ID: 15211824-a197-4b98-81e3-e4ac9c653986 with Priority: HIGHEST for action security_group_rules [ 989.779446] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15211824-a197-4b98-81e3-e4ac9c653986 with Priority: HIGHEST for action security_group_rules [ 989.779776] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15211824-a197-4b98-81e3-e4ac9c653986 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.779901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15211824-a197-4b98-81e3-e4ac9c653986" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.779971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15211824-a197-4b98-81e3-e4ac9c653986" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.783420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15211824-a197-4b98-81e3-e4ac9c653986" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.783518] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15211824-a197-4b98-81e3-e4ac9c653986',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.031084] env[69499]: INFO networking_nsxv3.common.synchronization [None req-5ccb3c1b-7708-410b-83e0-8e25e55f9ba7 tempest-ServerDiskConfigTestJSON-146039362 tempest-ServerDiskConfigTestJSON-146039362-project-member] Enqueued Resource ID: 15211824-a197-4b98-81e3-e4ac9c653986 with Priority: HIGHEST for action security_group_rules [ 990.032087] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15211824-a197-4b98-81e3-e4ac9c653986 with Priority: HIGHEST for action security_group_rules [ 990.032929] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15211824-a197-4b98-81e3-e4ac9c653986 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.033261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15211824-a197-4b98-81e3-e4ac9c653986" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.198995] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fb72b46-15ac-40d6-9596-7b8a3021877f [ 990.200276] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.200276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.200276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.200276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.200276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.200276] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fb72b46-15ac-40d6-9596-7b8a3021877f already deleted. [ 990.200276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fb72b46-15ac-40d6-9596-7b8a3021877f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.310204] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.310204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.310204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.310204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.310204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.310204] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15211824-a197-4b98-81e3-e4ac9c653986 already deleted. [ 990.310204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15211824-a197-4b98-81e3-e4ac9c653986" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.310204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15211824-a197-4b98-81e3-e4ac9c653986" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.310204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15211824-a197-4b98-81e3-e4ac9c653986" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.310204] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15211824-a197-4b98-81e3-e4ac9c653986',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.829798] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.829798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.829798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.829798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.829798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.829798] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15211824-a197-4b98-81e3-e4ac9c653986 already deleted. [ 990.829798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15211824-a197-4b98-81e3-e4ac9c653986" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.099966] env[69499]: INFO networking_nsxv3.common.synchronization [None req-a1802679-69b7-4521-a740-df090ca3d1b6 None None] Enqueued Resource ID: 5def4ddc-2069-48b5-ab66-bc2e5cf99986 with Priority: HIGHEST for action port [ 992.100386] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5def4ddc-2069-48b5-ab66-bc2e5cf99986 with Priority: HIGHEST for action port [ 992.100798] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-5def4ddc-2069-48b5-ab66-bc2e5cf99986 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.102105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5def4ddc-2069-48b5-ab66-bc2e5cf99986" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.102292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5def4ddc-2069-48b5-ab66-bc2e5cf99986" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.102888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5def4ddc-2069-48b5-ab66-bc2e5cf99986" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.102888] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5def4ddc-2069-48b5-ab66-bc2e5cf99986',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.113248] env[69499]: INFO networking_nsxv3.common.synchronization [None req-a9daa1c4-c931-4361-b881-8208a84296dd None None] Enqueued Resource ID: bd59ed56-abf3-4286-a2fd-5ca0cc2c69d6 with Priority: HIGHEST for action port [ 992.113380] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd59ed56-abf3-4286-a2fd-5ca0cc2c69d6 with Priority: HIGHEST for action port [ 992.113917] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd59ed56-abf3-4286-a2fd-5ca0cc2c69d6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.114047] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd59ed56-abf3-4286-a2fd-5ca0cc2c69d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.114118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd59ed56-abf3-4286-a2fd-5ca0cc2c69d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.114342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd59ed56-abf3-4286-a2fd-5ca0cc2c69d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.114424] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd59ed56-abf3-4286-a2fd-5ca0cc2c69d6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.604385] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5def4ddc-2069-48b5-ab66-bc2e5cf99986 [ 992.604634] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.604786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.604849] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.605085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.605188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.605285] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5def4ddc-2069-48b5-ab66-bc2e5cf99986 already deleted. [ 992.605365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5def4ddc-2069-48b5-ab66-bc2e5cf99986" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.622576] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd59ed56-abf3-4286-a2fd-5ca0cc2c69d6 [ 992.624769] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.624844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.624947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.628396] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.628396] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.628396] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd59ed56-abf3-4286-a2fd-5ca0cc2c69d6 already deleted. [ 992.628396] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd59ed56-abf3-4286-a2fd-5ca0cc2c69d6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.052285] env[69499]: INFO networking_nsxv3.common.synchronization [req-8866690a-4a66-4cf3-8a73-66469b48bb72 req-d126f678-b52f-4cdf-a105-292e6f0dafc7 tempest-ServerDiskConfigTestJSON-146039362 tempest-ServerDiskConfigTestJSON-146039362-project-member] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 994.053331] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 994.054715] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.054910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.055051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.055751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.055751] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.055751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.055751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.055751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.055751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.057073] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.258122] env[69499]: INFO networking_nsxv3.common.synchronization [None req-97ca1c7a-2fb6-451d-8dd3-141035a2a09e tempest-ServerActionsTestOtherB-1591609705 tempest-ServerActionsTestOtherB-1591609705-project-member] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_rules [ 994.258306] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_rules [ 994.258602] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.258725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.258793] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.259816] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.259934] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.319769] env[69499]: INFO networking_nsxv3.common.synchronization [req-9afa87aa-1b51-4644-9f1e-50529491079e req-37f1cd82-8a1e-4bb1-a21d-376a454beac7 tempest-InstanceActionsNegativeTestJSON-1136700417 tempest-InstanceActionsNegativeTestJSON-1136700417-project-member] Enqueued Resource ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 with Priority: HIGHEST for action security_group_members [ 994.320635] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 with Priority: HIGHEST for action security_group_members [ 994.320968] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0e4115-ee30-417b-a8e4-6acc1ae30669 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.322811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.322811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.323086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.323266] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.324249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.324249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.324249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.324249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.324249] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d0e4115-ee30-417b-a8e4-6acc1ae30669',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.340641] env[69499]: INFO networking_nsxv3.common.synchronization [None req-c22f732b-735c-4642-9ee7-c0ba5858c588 None None] Enqueued Resource ID: 27513425-10ae-4131-b421-7a28cb1075eb with Priority: HIGHEST for action port [ 994.340641] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27513425-10ae-4131-b421-7a28cb1075eb with Priority: HIGHEST for action port [ 994.340641] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-27513425-10ae-4131-b421-7a28cb1075eb taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.340641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27513425-10ae-4131-b421-7a28cb1075eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.340641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27513425-10ae-4131-b421-7a28cb1075eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.340641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27513425-10ae-4131-b421-7a28cb1075eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.340641] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27513425-10ae-4131-b421-7a28cb1075eb',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.489215] env[69499]: INFO networking_nsxv3.common.synchronization [None req-91156d79-afb0-4262-9bf1-64b74483115e tempest-ServerActionsTestOtherB-1591609705 tempest-ServerActionsTestOtherB-1591609705-project-member] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_rules [ 994.489215] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_rules [ 994.489215] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.489215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.562427] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.562427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.562427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.562427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.562427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.562427] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.562427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.562427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.562427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.562427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.562427] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be updated. [ 994.589984] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.589984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.589984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.589984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.589984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.596653] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 994.719584] env[69499]: INFO networking_nsxv3.common.synchronization [None req-18236ba0-34e9-4a5b-8d89-fdbe7fd596f2 None None] Enqueued Resource ID: 644a8893-59eb-4fed-a33f-88f2015243e9 with Priority: HIGHEST for action port [ 994.719584] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 644a8893-59eb-4fed-a33f-88f2015243e9 with Priority: HIGHEST for action port [ 994.719997] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-644a8893-59eb-4fed-a33f-88f2015243e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.720103] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-644a8893-59eb-4fed-a33f-88f2015243e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.720103] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-644a8893-59eb-4fed-a33f-88f2015243e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.720390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-644a8893-59eb-4fed-a33f-88f2015243e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.720463] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('644a8893-59eb-4fed-a33f-88f2015243e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.789268] env[69499]: INFO networking_nsxv3.common.synchronization [None req-4d978769-60a2-4344-bece-525e059dfc33 None None] Enqueued Resource ID: 6a0b7e95-c674-473a-9981-f15c2d19d487 with Priority: HIGHEST for action port [ 994.789940] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.790105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.790198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.790430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.791378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.791378] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b already deleted. [ 994.791378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.791378] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0b7e95-c674-473a-9981-f15c2d19d487 with Priority: HIGHEST for action port [ 994.791378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.791621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.791621] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.792415] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a0b7e95-c674-473a-9981-f15c2d19d487 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.792542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a0b7e95-c674-473a-9981-f15c2d19d487" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.792591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a0b7e95-c674-473a-9981-f15c2d19d487" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.792791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a0b7e95-c674-473a-9981-f15c2d19d487" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.792866] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a0b7e95-c674-473a-9981-f15c2d19d487',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.828520] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.828520] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.828520] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.829421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.829421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.829421] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.829421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.829421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.829421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.829421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.829421] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 already deleted. [ 994.830042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.842422] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27513425-10ae-4131-b421-7a28cb1075eb [ 994.842422] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.842422] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.842422] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.843771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.843771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.843771] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27513425-10ae-4131-b421-7a28cb1075eb already deleted. [ 994.843771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27513425-10ae-4131-b421-7a28cb1075eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.876879] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.876879] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-766" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.876879] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-766" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.876879] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-766" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.877446] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.878069] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.878171] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.878520] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.878688] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.878907] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.879042] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.879159] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.879321] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.879443] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.879615] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.879687] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.898707] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.898877] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 994.899035] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.899227] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-766" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.899579] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-45aa4167-228a-4f8d-9276-2c3ce52a7d10 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.899778] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-45aa4167-228a-4f8d-9276-2c3ce52a7d10" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.899905] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-45aa4167-228a-4f8d-9276-2c3ce52a7d10" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.900254] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-45aa4167-228a-4f8d-9276-2c3ce52a7d10" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.900409] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45aa4167-228a-4f8d-9276-2c3ce52a7d10',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.223542] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 644a8893-59eb-4fed-a33f-88f2015243e9 [ 995.223542] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.223542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.223542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.223542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.223542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.223542] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:644a8893-59eb-4fed-a33f-88f2015243e9 already deleted. [ 995.224261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-644a8893-59eb-4fed-a33f-88f2015243e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.299290] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a0b7e95-c674-473a-9981-f15c2d19d487 [ 995.299290] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.299290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.299290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.299290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.299290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.299290] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a0b7e95-c674-473a-9981-f15c2d19d487 already deleted. [ 995.299290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a0b7e95-c674-473a-9981-f15c2d19d487" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.314599] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.314824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.314901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.315097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.315188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.315329] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b already deleted. [ 995.315382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.403948] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.403948] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.404109] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.404349] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.404498] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.404659] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 45aa4167-228a-4f8d-9276-2c3ce52a7d10 not found, creating... [ 995.404920] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.405089] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.405987] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.405987] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.405987] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.405987] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.406304] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.406304] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.406812] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.406812] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.406812] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 45aa4167-228a-4f8d-9276-2c3ce52a7d10 is going to be created. [ 995.426617] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.428025] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.428255] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.428548] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.428778] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.429031] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-45aa4167-228a-4f8d-9276-2c3ce52a7d10" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.480926] env[69499]: INFO networking_nsxv3.common.synchronization [None req-606fd5cd-7a28-4b26-ad30-35680b65f438 None None] Enqueued Resource ID: b51f076d-0bb1-4b18-bf75-09a8045c866d with Priority: HIGHEST for action port [ 996.481343] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b51f076d-0bb1-4b18-bf75-09a8045c866d with Priority: HIGHEST for action port [ 996.481978] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-b51f076d-0bb1-4b18-bf75-09a8045c866d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.482141] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b51f076d-0bb1-4b18-bf75-09a8045c866d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.482875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b51f076d-0bb1-4b18-bf75-09a8045c866d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.482875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b51f076d-0bb1-4b18-bf75-09a8045c866d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.482875] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b51f076d-0bb1-4b18-bf75-09a8045c866d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.509422] env[69499]: INFO networking_nsxv3.common.synchronization [req-9afa87aa-1b51-4644-9f1e-50529491079e req-deffc02b-a807-4b77-9af5-5f73e25450f9 service nova] Enqueued Resource ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 with Priority: HIGHEST for action security_group_rules [ 996.509422] env[69499]: INFO networking_nsxv3.common.synchronization [req-9afa87aa-1b51-4644-9f1e-50529491079e req-deffc02b-a807-4b77-9af5-5f73e25450f9 service nova] Enqueued Resource ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 with Priority: HIGHEST for action security_group_members [ 996.509574] env[69499]: INFO networking_nsxv3.common.synchronization [req-9afa87aa-1b51-4644-9f1e-50529491079e req-deffc02b-a807-4b77-9af5-5f73e25450f9 service nova] Enqueued Resource ID: 45aa4167-228a-4f8d-9276-2c3ce52a7d10 with Priority: HIGHEST for action port [ 996.509790] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 with Priority: HIGHEST for action security_group_rules [ 996.509909] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 with Priority: HIGHEST for action security_group_members [ 996.510008] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45aa4167-228a-4f8d-9276-2c3ce52a7d10 with Priority: HIGHEST for action port [ 996.510540] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d0e4115-ee30-417b-a8e4-6acc1ae30669 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.510702] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.510752] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.510959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.511733] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d0e4115-ee30-417b-a8e4-6acc1ae30669',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.512846] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0e4115-ee30-417b-a8e4-6acc1ae30669 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.512955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.514708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.515008] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.515314] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.515314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.515435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.515503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.515667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.515667] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d0e4115-ee30-417b-a8e4-6acc1ae30669',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.516807] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-45aa4167-228a-4f8d-9276-2c3ce52a7d10 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.516931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45aa4167-228a-4f8d-9276-2c3ce52a7d10" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.517040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45aa4167-228a-4f8d-9276-2c3ce52a7d10" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.517201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45aa4167-228a-4f8d-9276-2c3ce52a7d10" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.517279] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45aa4167-228a-4f8d-9276-2c3ce52a7d10',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.605987] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 996.606674] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 deletion is rescheduled due to dependency. [ 996.606674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.985658] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b51f076d-0bb1-4b18-bf75-09a8045c866d [ 996.985941] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.986104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.986166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.986395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.986492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.986653] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b51f076d-0bb1-4b18-bf75-09a8045c866d already deleted. [ 996.986721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b51f076d-0bb1-4b18-bf75-09a8045c866d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.022415] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d0e4115-ee30-417b-a8e4-6acc1ae30669',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.023546] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0e4115-ee30-417b-a8e4-6acc1ae30669 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.023729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.023848] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45aa4167-228a-4f8d-9276-2c3ce52a7d10 with status ACTIVE [ 997.024034] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.024146] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.024222] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.024503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.024608] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.024815] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.024917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.025008] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.025264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.025264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.025478] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.027311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.027405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.027565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.027657] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.027761] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45aa4167-228a-4f8d-9276-2c3ce52a7d10 is going to be updated. [ 997.054449] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.054597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.054729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.054940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.054993] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.055231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45aa4167-228a-4f8d-9276-2c3ce52a7d10" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.531354] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d0e4115-ee30-417b-a8e4-6acc1ae30669',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.597579] env[69499]: INFO networking_nsxv3.common.synchronization [None req-f20a0d2e-1a38-4381-bf17-6b2ca676a33f None None] Enqueued Resource ID: 79f6d6ee-1095-4669-aa5a-c46ff1aa6788 with Priority: HIGHEST for action port [ 997.598161] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79f6d6ee-1095-4669-aa5a-c46ff1aa6788 with Priority: HIGHEST for action port [ 997.598510] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-79f6d6ee-1095-4669-aa5a-c46ff1aa6788 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.598687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79f6d6ee-1095-4669-aa5a-c46ff1aa6788" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.598758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79f6d6ee-1095-4669-aa5a-c46ff1aa6788" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.599041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79f6d6ee-1095-4669-aa5a-c46ff1aa6788" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.599124] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79f6d6ee-1095-4669-aa5a-c46ff1aa6788',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.033724] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.034345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.034472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.034799] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.034961] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.035124] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 is going to be created. [ 998.058680] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.058831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.061423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.061423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.061423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.069274] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 in Status: UNINITIALIZED for 2s [ 998.100969] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79f6d6ee-1095-4669-aa5a-c46ff1aa6788 [ 998.101266] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.101404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.101475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.101729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.101896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.101937] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79f6d6ee-1095-4669-aa5a-c46ff1aa6788 already deleted. [ 998.101997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79f6d6ee-1095-4669-aa5a-c46ff1aa6788" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.079395] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 in Status: SUCCESS [ 1000.079744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.079744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.079937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.080147] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.080266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.080338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.080484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.080564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.080648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.080732] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d0e4115-ee30-417b-a8e4-6acc1ae30669',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.583107] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0e4115-ee30-417b-a8e4-6acc1ae30669 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.583283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.583359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.583599] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.583805] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.583950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.584410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.584410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.584410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.584410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.584648] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0e4115-ee30-417b-a8e4-6acc1ae30669 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.584648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.584907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.584960] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.585189] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.585342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.585434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.585637] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.585747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.585872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.585991] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d0e4115-ee30-417b-a8e4-6acc1ae30669',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.088488] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d0e4115-ee30-417b-a8e4-6acc1ae30669: rpc.has_security_group_logging(os_id): False [ 1001.106132] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.106284] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.106468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.106589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.106643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.106858] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.106957] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.107029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.107182] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.107258] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.107497] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.107612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.107612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.108199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.108199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.108199] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.108199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.108199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.108562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.108562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.108562] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 is going to be created. [ 1001.274349] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.274498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.274571] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.274793] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.274972] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.284882] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 in Status: IN_PROGRESS for 2s [ 1002.599769] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1002.599769] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1003.300984] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 in Status: SUCCESS [ 1003.301177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.161648] env[69499]: INFO networking_nsxv3.common.synchronization [req-9ebf17d8-2fc1-4227-8049-1a9049768e76 req-758ecd19-83dd-465a-8d6a-d791561430f4 tempest-ServersTestJSON-756379483 tempest-ServersTestJSON-756379483-project-member] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1004.162218] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1004.162534] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.162664] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.164152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.168411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.168615] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.168717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.168998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.168998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.168998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.169200] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.221776] env[69499]: INFO networking_nsxv3.common.synchronization [req-c5d1362f-2506-46e4-8c63-f5e37fd3c0d8 req-7b095685-f219-40c7-837c-13cc5e224a85 tempest-ServerActionsTestJSON-629709431 tempest-ServerActionsTestJSON-629709431-project-member] Enqueued Resource ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea with Priority: HIGHEST for action security_group_members [ 1004.223169] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea with Priority: HIGHEST for action security_group_members [ 1004.223169] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.223169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.223169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.223169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.224807] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.225779] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.225779] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.225865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.225901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.225978] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.615362] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.615601] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.615766] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.617392] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.617744] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.618283] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.618283] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.619910] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.620124] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.620468] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.621186] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.621575] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.621731] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.621931] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.622144] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.622380] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.643211] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.643484] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1004.643713] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.644018] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.644459] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-1271a106-a90e-4631-bd71-a7b444f8d302 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.644712] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-1271a106-a90e-4631-bd71-a7b444f8d302" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.644901] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-1271a106-a90e-4631-bd71-a7b444f8d302" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.645786] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-1271a106-a90e-4631-bd71-a7b444f8d302" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.646043] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1271a106-a90e-4631-bd71-a7b444f8d302',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.671490] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.671655] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.671730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.671927] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.672098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.672383] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.672480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.672557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.672747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.672875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.672950] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f already deleted. [ 1004.672987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.730379] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.730735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.730773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.731068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.731218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.731580] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.731783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.731863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.732035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.732132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.732250] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea is going to be updated. [ 1004.761839] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.762037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.762182] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.762332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.762476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.770879] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea in Status: IN_PROGRESS for 2s [ 1005.150657] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.150913] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.151057] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.151681] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.151873] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.152104] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 1271a106-a90e-4631-bd71-a7b444f8d302 not found, creating... [ 1005.152448] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.152652] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.153282] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.153614] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.155992] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.155992] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.155992] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.155992] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.155992] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.155992] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.155992] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 1271a106-a90e-4631-bd71-a7b444f8d302 is going to be created. [ 1005.178517] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.178517] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.178517] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.178517] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.178517] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.178517] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-1271a106-a90e-4631-bd71-a7b444f8d302" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.848971] env[69499]: INFO networking_nsxv3.common.synchronization [req-9ebf17d8-2fc1-4227-8049-1a9049768e76 req-cd7a7e40-435d-4afe-bcf9-856a7db67303 service nova] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_rules [ 1005.849276] env[69499]: INFO networking_nsxv3.common.synchronization [req-9ebf17d8-2fc1-4227-8049-1a9049768e76 req-cd7a7e40-435d-4afe-bcf9-856a7db67303 service nova] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1005.849501] env[69499]: INFO networking_nsxv3.common.synchronization [req-9ebf17d8-2fc1-4227-8049-1a9049768e76 req-cd7a7e40-435d-4afe-bcf9-856a7db67303 service nova] Enqueued Resource ID: 1271a106-a90e-4631-bd71-a7b444f8d302 with Priority: HIGHEST for action port [ 1005.850037] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_rules [ 1005.850182] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1005.850268] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1271a106-a90e-4631-bd71-a7b444f8d302 with Priority: HIGHEST for action port [ 1005.850567] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.851271] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.851358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.851617] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.851709] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.853378] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.853378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.853378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.853378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.853378] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.853623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.855150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.855150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.855150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.855150] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.855544] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-1271a106-a90e-4631-bd71-a7b444f8d302 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.855544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1271a106-a90e-4631-bd71-a7b444f8d302" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.855544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1271a106-a90e-4631-bd71-a7b444f8d302" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.855544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1271a106-a90e-4631-bd71-a7b444f8d302" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.855704] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1271a106-a90e-4631-bd71-a7b444f8d302',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.357945] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.358771] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.358771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.360782] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1271a106-a90e-4631-bd71-a7b444f8d302 with status ACTIVE [ 1006.360782] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.360782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.360782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.360782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.360782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.360782] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.360782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.360782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.361517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.361552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.361777] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.361878] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.361921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.362077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.362149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.362231] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1271a106-a90e-4631-bd71-a7b444f8d302 is going to be updated. [ 1006.384529] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.384684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.384758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.384964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.385110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.385260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1271a106-a90e-4631-bd71-a7b444f8d302" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.401062] env[69499]: INFO networking_nsxv3.common.synchronization [req-18aa21c9-b2e8-4acf-98e6-bab35fdb3fd1 req-ea9ca04e-31bc-45d2-8a40-89d51c9f3819 tempest-ServerDiskConfigTestJSON-146039362 tempest-ServerDiskConfigTestJSON-146039362-project-member] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 1006.401662] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 1006.401974] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.402112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.402175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.402378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.402539] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.402638] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.402699] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.402845] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.402929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.403372] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.707678] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.707890] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.708198] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.708538] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.708796] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.709013] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.709188] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.709655] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.709825] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.710056] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.710173] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.710284] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.710418] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.710545] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.710654] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.710800] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.730072] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.730725] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1006.730725] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.730725] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.731438] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-1bb85da3-4674-4d6f-9739-d04c0bee51e2 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.731438] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-1bb85da3-4674-4d6f-9739-d04c0bee51e2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.731438] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-1bb85da3-4674-4d6f-9739-d04c0bee51e2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.731617] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-1bb85da3-4674-4d6f-9739-d04c0bee51e2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.732026] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bb85da3-4674-4d6f-9739-d04c0bee51e2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.780238] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea in Status: SUCCESS [ 1006.780525] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea deletion is rescheduled due to dependency. [ 1006.780525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.864475] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.906158] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.906685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.906685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.906685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.906685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.906861] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.906966] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.907008] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.907165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.907237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.907350] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be updated. [ 1006.931007] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.931156] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.931229] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.931428] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.931650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.934515] env[69499]: INFO networking_nsxv3.common.synchronization [req-8747d356-18a5-439a-aa9a-e914ccd52c88 req-786719d5-5fff-4005-b283-088d81d2aa48 tempest-InstanceActionsNegativeTestJSON-1136700417 tempest-InstanceActionsNegativeTestJSON-1136700417-project-member] Enqueued Resource ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 with Priority: HIGHEST for action security_group_members [ 1006.935042] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 with Priority: HIGHEST for action security_group_members [ 1006.935384] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0e4115-ee30-417b-a8e4-6acc1ae30669 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.935501] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.935567] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.935747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.935894] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.935988] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.936060] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.936218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.936298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.936389] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d0e4115-ee30-417b-a8e4-6acc1ae30669',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.940259] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 1007.234796] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.235029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.235162] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.235456] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.235611] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.235764] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 1bb85da3-4674-4d6f-9739-d04c0bee51e2 not found, creating... [ 1007.236039] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.236241] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.236364] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.236584] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.236764] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.237104] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.237271] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.237386] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.237597] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.237737] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.237884] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 1bb85da3-4674-4d6f-9739-d04c0bee51e2 is going to be created. [ 1007.257196] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.257542] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.257727] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.257930] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.258212] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.258415] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-1bb85da3-4674-4d6f-9739-d04c0bee51e2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.366564] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.366900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.366900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.367174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.367348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.367501] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be created. [ 1007.395403] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.395548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.395620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.395827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.395976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.408712] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: UNINITIALIZED for 2s [ 1007.438489] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.438656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.438747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.439011] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.439116] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.439430] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.439607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.439682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.439855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.439939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.440049] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 is going to be updated. [ 1007.473465] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.473693] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.473826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.474115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.474338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.483041] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 in Status: IN_PROGRESS for 2s [ 1007.986983] env[69499]: INFO networking_nsxv3.common.synchronization [req-18aa21c9-b2e8-4acf-98e6-bab35fdb3fd1 req-3fc28f1a-582b-4877-ac0a-46fafc946eae service nova] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_rules [ 1007.987506] env[69499]: INFO networking_nsxv3.common.synchronization [req-18aa21c9-b2e8-4acf-98e6-bab35fdb3fd1 req-3fc28f1a-582b-4877-ac0a-46fafc946eae service nova] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 1007.987506] env[69499]: INFO networking_nsxv3.common.synchronization [req-18aa21c9-b2e8-4acf-98e6-bab35fdb3fd1 req-3fc28f1a-582b-4877-ac0a-46fafc946eae service nova] Enqueued Resource ID: 1bb85da3-4674-4d6f-9739-d04c0bee51e2 with Priority: HIGHEST for action port [ 1007.988414] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_rules [ 1007.988414] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 1007.988414] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb85da3-4674-4d6f-9739-d04c0bee51e2 with Priority: HIGHEST for action port [ 1007.988712] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.988712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.988815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.988958] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.989053] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.989967] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.990099] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.990346] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bb85da3-4674-4d6f-9739-d04c0bee51e2 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.990463] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bb85da3-4674-4d6f-9739-d04c0bee51e2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.990463] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bb85da3-4674-4d6f-9739-d04c0bee51e2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.990633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bb85da3-4674-4d6f-9739-d04c0bee51e2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.990710] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bb85da3-4674-4d6f-9739-d04c0bee51e2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.498202] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.498202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.498202] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1bb85da3-4674-4d6f-9739-d04c0bee51e2 with status ACTIVE [ 1008.498202] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.498202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.498202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.498202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.498202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.498202] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.498202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.498202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.498202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.498202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.498202] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.498897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.498897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.498897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.498897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.498897] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1bb85da3-4674-4d6f-9739-d04c0bee51e2 is going to be updated. [ 1008.535913] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.536186] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.536751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.536751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.536751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.536905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bb85da3-4674-4d6f-9739-d04c0bee51e2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.949564] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 1008.949738] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 deletion is rescheduled due to dependency. [ 1008.949848] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.950092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.950344] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.950496] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.950611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.950675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.950825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.950919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.950991] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.418039] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1009.418278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.418447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.418665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.418859] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.418976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.419053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.419210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.419316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.419452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.419545] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.453038] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.492647] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 in Status: SUCCESS [ 1009.492647] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 deletion is rescheduled due to dependency. [ 1009.492647] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.921867] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.922294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.922294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.922413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.922493] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.922595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.922659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.922812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.922895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.922981] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.923148] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.923234] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.923295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.923446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.923569] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.923682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.923784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.923933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.924016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.924097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.924187] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.955818] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.426238] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf01aae2-c409-4ed9-940b-99698ec3968f: rpc.has_security_group_logging(os_id): False [ 1010.444146] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.444312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.444367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.444633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.444731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.445205] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.445336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.445404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.445572] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.445653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.445894] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.445998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.446175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.446288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.446288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.446478] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.446570] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.446630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.446772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.446945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.446945] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be created. [ 1010.457766] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.457926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.458049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.458298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.458391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.458499] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be updated. [ 1010.490208] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.490776] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.490852] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.491105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.491257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.501701] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 1010.502962] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.503183] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.503291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.503582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.503866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.514058] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1012.288934] env[69499]: INFO networking_nsxv3.common.synchronization [None req-4dc01ba3-d4aa-4969-bd1f-827d96a5ed66 tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGHEST for action security_group_rules [ 1012.289667] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGHEST for action security_group_rules [ 1012.290150] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.290338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.290435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.290735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.290822] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3b4e2d2-bd4c-4aa0-be81-75c881b79d89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.355174] env[69499]: INFO networking_nsxv3.common.synchronization [None req-1c88c0f5-c280-4642-8014-d58ee10e1586 tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGHEST for action security_group_rules [ 1012.355848] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGHEST for action security_group_rules [ 1012.356245] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.356537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.512645] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 1012.512821] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.513038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.513236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.513428] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.513545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.513613] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.513762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.513841] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.513927] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.514023] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.523744] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1012.523744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.809042] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.809202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.809202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.809446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.809531] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.809633] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 already deleted. [ 1012.809713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.809855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.810017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.810097] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3b4e2d2-bd4c-4aa0-be81-75c881b79d89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.850111] env[69499]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1012.850266] env[69499]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1013.018104] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.018327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.018405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.018625] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.018782] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.018877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.018934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.019090] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.019179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.019276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.019453] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.019580] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.019664] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.019850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.020026] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.020138] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.020215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.020380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.020461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.020549] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.020646] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.303754] env[69499]: INFO networking_nsxv3.common.synchronization [req-7d609260-d646-4ce1-82ef-12a010cf1262 req-021cf63a-aaa4-44f9-acc6-1cf97ae6a42a tempest-ServerActionsTestOtherB-1591609705 tempest-ServerActionsTestOtherB-1591609705-project-member] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1013.304371] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1013.304773] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.304901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.305961] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.308237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.308439] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.308630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.308630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.310122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.310122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.310122] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.332723] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.332917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.333036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.333236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.333348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.333432] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 already deleted. [ 1013.333537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.524879] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31a7bec7-75f3-4780-ac90-0f2f7e7744e9: rpc.has_security_group_logging(os_id): False [ 1013.555226] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.555401] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.555478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.555655] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.555746] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.556747] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.556747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.556747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.556747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.556747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.556747] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.556747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.556747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.557627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.557627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.557627] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.557627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.557627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.561038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.561190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.561293] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be updated. [ 1013.629606] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.629606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.629606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.629606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.629606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.640516] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 1013.812443] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.812723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.812723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.812896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.813403] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.813403] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.813403] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.813583] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.813685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.813795] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.813934] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b already deleted. [ 1013.814065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.916678] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-728 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.916881] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.917014] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.917459] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.917735] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.917903] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.918065] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.918307] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.918465] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.918681] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.918801] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.918915] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.919029] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.919147] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.919259] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.919465] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.936567] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.936737] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1013.936882] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.937080] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.937391] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-140e39b1-c8cd-440a-986c-bc37fe5fbf98 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.937565] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-140e39b1-c8cd-440a-986c-bc37fe5fbf98" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.937713] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-140e39b1-c8cd-440a-986c-bc37fe5fbf98" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.937991] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-140e39b1-c8cd-440a-986c-bc37fe5fbf98" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.938147] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('140e39b1-c8cd-440a-986c-bc37fe5fbf98',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.440695] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.441010] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.441158] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.441539] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.441696] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.441862] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 140e39b1-c8cd-440a-986c-bc37fe5fbf98 not found, creating... [ 1014.442146] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.442312] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.442434] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.442676] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.442819] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.443135] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.443302] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.443423] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.443674] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.443817] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.443959] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 140e39b1-c8cd-440a-986c-bc37fe5fbf98 is going to be created. [ 1014.463107] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.463299] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.463450] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.463738] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.463969] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.464204] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-140e39b1-c8cd-440a-986c-bc37fe5fbf98" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.252066] env[69499]: INFO networking_nsxv3.common.synchronization [req-7d609260-d646-4ce1-82ef-12a010cf1262 req-5f38a6c7-57aa-4d15-9fea-3696fdb60eab service nova] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_rules [ 1015.252440] env[69499]: INFO networking_nsxv3.common.synchronization [req-7d609260-d646-4ce1-82ef-12a010cf1262 req-5f38a6c7-57aa-4d15-9fea-3696fdb60eab service nova] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1015.252440] env[69499]: INFO networking_nsxv3.common.synchronization [req-7d609260-d646-4ce1-82ef-12a010cf1262 req-5f38a6c7-57aa-4d15-9fea-3696fdb60eab service nova] Enqueued Resource ID: 140e39b1-c8cd-440a-986c-bc37fe5fbf98 with Priority: HIGHEST for action port [ 1015.254944] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_rules [ 1015.254944] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1015.254944] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 140e39b1-c8cd-440a-986c-bc37fe5fbf98 with Priority: HIGHEST for action port [ 1015.255253] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.255385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.255454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.255658] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.255738] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.256933] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.257066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.257138] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.257320] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.257465] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.257562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.257625] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.257770] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.257857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.257947] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.259141] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-140e39b1-c8cd-440a-986c-bc37fe5fbf98 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.259257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-140e39b1-c8cd-440a-986c-bc37fe5fbf98" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.259319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-140e39b1-c8cd-440a-986c-bc37fe5fbf98" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.259592] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-140e39b1-c8cd-440a-986c-bc37fe5fbf98" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.260523] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('140e39b1-c8cd-440a-986c-bc37fe5fbf98',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.620194] env[69499]: INFO networking_nsxv3.common.synchronization [req-853f2061-36a0-49f5-9e49-a4e574ed65ad req-ea67c8c0-460f-4d0e-b07f-7cc5c1c368bb tempest-ServerRescueTestJSONUnderV235-1666585610 tempest-ServerRescueTestJSONUnderV235-1666585610-project-member] Enqueued Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_members [ 1015.620666] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_members [ 1015.620946] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.621096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.621223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.621408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.621563] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.621662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.621725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.622078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.622078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.622268] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.654671] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 1015.654894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.759710] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.760809] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.760938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.762441] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 140e39b1-c8cd-440a-986c-bc37fe5fbf98 with status ACTIVE [ 1015.762622] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.762756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.762859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.763067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.763161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.763343] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.763456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.763508] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.763663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.763743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.763921] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.764029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.764323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.764323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.764323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.764454] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 140e39b1-c8cd-440a-986c-bc37fe5fbf98 is going to be updated. [ 1015.784738] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.784883] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.784946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.785159] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.785296] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.785449] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-140e39b1-c8cd-440a-986c-bc37fe5fbf98" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.942541] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-871 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.942822] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-871" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.942889] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-871" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.944024] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-871" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.944024] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.944214] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.944419] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.944680] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.944838] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.945065] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.945187] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.945301] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.945417] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.945532] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.945641] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.945830] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.975452] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.975452] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1015.975452] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.975571] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-871" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.975818] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-acce07e6-0920-45f4-beed-7e79cd48c175 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.976433] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.976433] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.976433] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.976686] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acce07e6-0920-45f4-beed-7e79cd48c175',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.124192] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.124347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.124415] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.124657] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.124737] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.124934] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.125050] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.125107] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.125331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.125331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.125459] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 already deleted. [ 1016.125500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.262639] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.484019] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.484019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.484019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.484019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.484019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.484019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port acce07e6-0920-45f4-beed-7e79cd48c175 not found, creating... [ 1016.484019] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.484019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.484019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.484019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.484019] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.484645] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.484645] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.484645] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.484645] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.484645] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.484645] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: acce07e6-0920-45f4-beed-7e79cd48c175 is going to be created. [ 1016.506253] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.506655] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.506931] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.507283] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.507645] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.507979] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.767393] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.767393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.767393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.767393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.767393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.767393] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be created. [ 1016.788126] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.788297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.788364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.788555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.788714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.808300] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: UNINITIALIZED for 2s [ 1017.260810] env[69499]: INFO networking_nsxv3.common.synchronization [req-853f2061-36a0-49f5-9e49-a4e574ed65ad req-f85a5976-e29a-447d-b791-c9c058d235c8 service nova] Enqueued Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_rules [ 1017.261066] env[69499]: INFO networking_nsxv3.common.synchronization [req-853f2061-36a0-49f5-9e49-a4e574ed65ad req-f85a5976-e29a-447d-b791-c9c058d235c8 service nova] Enqueued Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_members [ 1017.261274] env[69499]: INFO networking_nsxv3.common.synchronization [req-853f2061-36a0-49f5-9e49-a4e574ed65ad req-f85a5976-e29a-447d-b791-c9c058d235c8 service nova] Enqueued Resource ID: acce07e6-0920-45f4-beed-7e79cd48c175 with Priority: HIGHEST for action port [ 1017.261902] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_rules [ 1017.262097] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_members [ 1017.262253] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acce07e6-0920-45f4-beed-7e79cd48c175 with Priority: HIGHEST for action port [ 1017.262579] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.262744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.262834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.263161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.263291] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.264237] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.264438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.264533] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.264770] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.265418] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.265811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.265811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.265811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.266321] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.266321] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.266960] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-acce07e6-0920-45f4-beed-7e79cd48c175 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.267130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.267218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.267542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.267651] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acce07e6-0920-45f4-beed-7e79cd48c175',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.769456] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.770772] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.770927] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.771197] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acce07e6-0920-45f4-beed-7e79cd48c175 with status ACTIVE [ 1017.771451] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.771625] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.771745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.772043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.772285] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.775310] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.775310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.775310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.775310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.775310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.775310] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.775310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.775310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.775310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.775310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.775310] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acce07e6-0920-45f4-beed-7e79cd48c175 is going to be updated. [ 1017.794063] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.794372] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.796134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.796134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.796134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.796134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.013889] env[69499]: INFO networking_nsxv3.common.synchronization [req-9279f990-632c-401c-91ad-b70b667dd40c req-3c57d343-fb89-4872-862b-b787618894b1 tempest-ServerMetadataTestJSON-1812772858 tempest-ServerMetadataTestJSON-1812772858-project-member] Enqueued Resource ID: a709c207-f73f-472d-bc52-25ccd049c6fc with Priority: HIGHEST for action security_group_members [ 1018.014445] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a709c207-f73f-472d-bc52-25ccd049c6fc with Priority: HIGHEST for action security_group_members [ 1018.014744] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a709c207-f73f-472d-bc52-25ccd049c6fc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.014864] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.014928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.015261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.015427] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.015528] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.015589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.015743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.015858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.015914] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a709c207-f73f-472d-bc52-25ccd049c6fc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.216846] env[69499]: INFO networking_nsxv3.common.synchronization [req-5499653b-f5f6-4619-b4dd-a0bc3a51108c req-6fd8d3da-d7aa-4b27-964b-209bebe18670 tempest-ServersTestManualDisk-216863239 tempest-ServersTestManualDisk-216863239-project-member] Enqueued Resource ID: 11b16049-e77a-4319-a5c3-228658ee669e with Priority: HIGHEST for action security_group_members [ 1018.217428] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11b16049-e77a-4319-a5c3-228658ee669e with Priority: HIGHEST for action security_group_members [ 1018.217748] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-11b16049-e77a-4319-a5c3-228658ee669e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.217873] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.217980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.218200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.218386] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.218512] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.218638] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.218763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.218880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.218959] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11b16049-e77a-4319-a5c3-228658ee669e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.277490] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.522650] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.522882] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.522977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.523244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.523368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.523599] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.523729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.523805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.523980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.524100] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.524220] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a709c207-f73f-472d-bc52-25ccd049c6fc already deleted. [ 1018.524327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.717619] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-319 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.717747] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-319" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.717910] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-319" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.718427] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-319" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.718750] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.718961] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.719125] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.720028] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.720028] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.720028] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.720028] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.720028] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.720327] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.720367] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.720515] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.720705] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.722182] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.722336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.722425] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.722622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.722738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.722939] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.723078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.723165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.723338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.723439] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.723548] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11b16049-e77a-4319-a5c3-228658ee669e is going to be updated. [ 1018.743093] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.743279] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.743421] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.743606] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-319" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.743930] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-a1d6a7fd-7411-430c-a771-670752b17f18 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.744154] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-a1d6a7fd-7411-430c-a771-670752b17f18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.744253] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-a1d6a7fd-7411-430c-a771-670752b17f18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.744575] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-a1d6a7fd-7411-430c-a771-670752b17f18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.744711] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1d6a7fd-7411-430c-a771-670752b17f18',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.755157] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.755287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.755501] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.755611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.755674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.763367] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11b16049-e77a-4319-a5c3-228658ee669e in Status: IN_PROGRESS for 2s [ 1018.783230] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.783555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.783555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.783672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.783763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.783865] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 is going to be created. [ 1018.803307] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.803465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.803518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.803733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.803891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.811716] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: UNINITIALIZED for 2s [ 1018.814832] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1018.815072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.815235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.815440] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.815628] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.815743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.815809] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.815964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.816058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.816203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.816257] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.247238] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.247390] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.247525] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.247812] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.247971] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.248150] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port a1d6a7fd-7411-430c-a771-670752b17f18 not found, creating... [ 1019.248467] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.248657] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.248798] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.249060] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.249239] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.249608] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.249830] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.250034] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.250266] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.250431] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.250639] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: a1d6a7fd-7411-430c-a771-670752b17f18 is going to be created. [ 1019.271993] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.272386] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.272621] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.273067] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.273449] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.273817] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-a1d6a7fd-7411-430c-a771-670752b17f18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.318362] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.823122] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 717f63b4-82e8-4749-8d24-1abe7790389b: rpc.has_security_group_logging(os_id): False [ 1019.840210] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.840447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.840852] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.841154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.841243] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.843020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.843020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.843020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.843020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.843020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.843020] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be created. [ 1019.954742] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.954922] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.955015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.955178] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.955359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.965168] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 2s [ 1020.045180] env[69499]: INFO networking_nsxv3.common.synchronization [req-9279f990-632c-401c-91ad-b70b667dd40c req-71c5074f-26b2-4e33-86f5-dc6675a37be1 service nova] Enqueued Resource ID: a709c207-f73f-472d-bc52-25ccd049c6fc with Priority: HIGHEST for action security_group_rules [ 1020.045365] env[69499]: INFO networking_nsxv3.common.synchronization [req-9279f990-632c-401c-91ad-b70b667dd40c req-71c5074f-26b2-4e33-86f5-dc6675a37be1 service nova] Enqueued Resource ID: a709c207-f73f-472d-bc52-25ccd049c6fc with Priority: HIGHEST for action security_group_members [ 1020.045519] env[69499]: INFO networking_nsxv3.common.synchronization [req-9279f990-632c-401c-91ad-b70b667dd40c req-71c5074f-26b2-4e33-86f5-dc6675a37be1 service nova] Enqueued Resource ID: a1d6a7fd-7411-430c-a771-670752b17f18 with Priority: HIGHEST for action port [ 1020.046072] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a709c207-f73f-472d-bc52-25ccd049c6fc with Priority: HIGHEST for action security_group_rules [ 1020.046234] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a709c207-f73f-472d-bc52-25ccd049c6fc with Priority: HIGHEST for action security_group_members [ 1020.046312] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d6a7fd-7411-430c-a771-670752b17f18 with Priority: HIGHEST for action port [ 1020.046603] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a709c207-f73f-472d-bc52-25ccd049c6fc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.046741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.046859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.047299] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.047397] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a709c207-f73f-472d-bc52-25ccd049c6fc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.048779] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a709c207-f73f-472d-bc52-25ccd049c6fc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.048842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.049231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.049231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.049321] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.049450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.049524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.049741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.049790] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.049881] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a709c207-f73f-472d-bc52-25ccd049c6fc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.050727] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1d6a7fd-7411-430c-a771-670752b17f18 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.050727] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1d6a7fd-7411-430c-a771-670752b17f18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.050888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1d6a7fd-7411-430c-a771-670752b17f18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.050940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1d6a7fd-7411-430c-a771-670752b17f18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.051019] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1d6a7fd-7411-430c-a771-670752b17f18',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.555484] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a709c207-f73f-472d-bc52-25ccd049c6fc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.555484] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a709c207-f73f-472d-bc52-25ccd049c6fc taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.555484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.555484] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1d6a7fd-7411-430c-a771-670752b17f18 with status ACTIVE [ 1020.555484] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.555484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.555484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.555484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.555484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.555484] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.555484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.555484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.557237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.557337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.557581] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.557713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.557759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.557910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.558090] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.558141] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1d6a7fd-7411-430c-a771-670752b17f18 is going to be updated. [ 1020.578226] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.578461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.578528] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.578801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.578970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.579245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1d6a7fd-7411-430c-a771-670752b17f18" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.771767] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11b16049-e77a-4319-a5c3-228658ee669e in Status: SUCCESS [ 1020.771970] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11b16049-e77a-4319-a5c3-228658ee669e deletion is rescheduled due to dependency. [ 1020.772098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.821347] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: SUCCESS [ 1020.821663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.821832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.822527] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.822527] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.822527] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.822527] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.822686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.822686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.822767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.822854] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.060353] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a709c207-f73f-472d-bc52-25ccd049c6fc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.326101] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.326263] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.326338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.326566] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.326731] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.327195] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.327270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.327429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.327544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.327667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.327838] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.327922] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.327982] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.328151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.328292] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.328384] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.328444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.328580] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.328656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.328736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.328825] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.566623] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.566787] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.566862] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.568061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.568061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.568061] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a709c207-f73f-472d-bc52-25ccd049c6fc is going to be created. [ 1021.588436] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.588626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.588698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.589011] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.589111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.597539] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a709c207-f73f-472d-bc52-25ccd049c6fc in Status: UNINITIALIZED for 2s [ 1021.832066] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a75c8cf2-8281-4188-a659-235b2c49d8f3: rpc.has_security_group_logging(os_id): False [ 1021.848344] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.848564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.848695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.848963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.849069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.849278] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.849407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.849470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.849620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.849721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.849956] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.850090] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.850157] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.850358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.850479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.850747] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.850855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.850917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.851075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.851152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.851239] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 is going to be created. [ 1021.902204] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.902423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.902423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.902648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.902832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.911495] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: IN_PROGRESS for 2s [ 1021.986495] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1021.986747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.608616] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a709c207-f73f-472d-bc52-25ccd049c6fc in Status: SUCCESS [ 1023.608616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.608616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.608616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.608616] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.608616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.608616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.608616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.608616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.608616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.608616] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a709c207-f73f-472d-bc52-25ccd049c6fc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.932447] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: SUCCESS [ 1023.932685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.113985] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a709c207-f73f-472d-bc52-25ccd049c6fc taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.114151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.114223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.114438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.114650] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.114744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.114814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.114969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.115070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.115161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.115309] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a709c207-f73f-472d-bc52-25ccd049c6fc taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.115465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.115522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.115633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.115773] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.115866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.115926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.116079] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.116155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.116235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.116321] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a709c207-f73f-472d-bc52-25ccd049c6fc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.475699] env[69499]: INFO networking_nsxv3.common.synchronization [req-cbb081f2-1025-4140-9b31-4ec589f48543 req-9c1f74bf-79ff-40d0-b61e-aa8cf417fcfa tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGHEST for action security_group_members [ 1024.475699] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGHEST for action security_group_members [ 1024.475699] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.475699] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.475699] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.475699] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.476797] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.476797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.476797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.476797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.476797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.476797] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3b4e2d2-bd4c-4aa0-be81-75c881b79d89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.620254] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a709c207-f73f-472d-bc52-25ccd049c6fc: rpc.has_security_group_logging(os_id): False [ 1024.639031] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.639031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.639031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.639031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.639031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.639031] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.639031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.639031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.639031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.639031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.639031] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.639031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.639031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.639031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.639031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.639803] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.639803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.639803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.639803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.639803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.639803] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a709c207-f73f-472d-bc52-25ccd049c6fc is going to be created. [ 1024.699568] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.699568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.699568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.699568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.699568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.708508] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a709c207-f73f-472d-bc52-25ccd049c6fc in Status: IN_PROGRESS for 2s [ 1024.896967] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.897206] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.897349] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.897646] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.897909] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.898097] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.898220] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.898444] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.899193] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.899193] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.899193] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.899193] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.899193] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.899484] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.899484] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.899562] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.918289] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.918469] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1024.918683] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.918797] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.919130] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-74f7b5cb-9129-46dc-8760-995c9c052d81 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.919309] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-74f7b5cb-9129-46dc-8760-995c9c052d81" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.919471] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-74f7b5cb-9129-46dc-8760-995c9c052d81" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.919794] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-74f7b5cb-9129-46dc-8760-995c9c052d81" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.919986] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74f7b5cb-9129-46dc-8760-995c9c052d81',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.979784] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.979946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.980048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.980259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.980354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.980571] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.980687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.980733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.980967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.981202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.981278] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 already deleted. [ 1024.981377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.422566] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.422796] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.422929] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.423310] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.423460] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.423622] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 74f7b5cb-9129-46dc-8760-995c9c052d81 not found, creating... [ 1025.423882] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.424069] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.424232] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.424529] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.424683] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.424973] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.425149] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.425323] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.425590] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.425727] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.425875] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 74f7b5cb-9129-46dc-8760-995c9c052d81 is going to be created. [ 1025.453902] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.454142] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.454278] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.454564] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.454855] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.455040] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-74f7b5cb-9129-46dc-8760-995c9c052d81" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.192908] env[69499]: INFO networking_nsxv3.common.synchronization [req-cbb081f2-1025-4140-9b31-4ec589f48543 req-c39deb22-a51c-4c5e-9ded-3e3aa0f5da8a service nova] Enqueued Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGHEST for action security_group_rules [ 1026.193211] env[69499]: INFO networking_nsxv3.common.synchronization [req-cbb081f2-1025-4140-9b31-4ec589f48543 req-c39deb22-a51c-4c5e-9ded-3e3aa0f5da8a service nova] Enqueued Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGHEST for action security_group_members [ 1026.193304] env[69499]: INFO networking_nsxv3.common.synchronization [req-cbb081f2-1025-4140-9b31-4ec589f48543 req-c39deb22-a51c-4c5e-9ded-3e3aa0f5da8a service nova] Enqueued Resource ID: 74f7b5cb-9129-46dc-8760-995c9c052d81 with Priority: HIGHEST for action port [ 1026.193558] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGHEST for action security_group_rules [ 1026.193705] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGHEST for action security_group_members [ 1026.193808] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7b5cb-9129-46dc-8760-995c9c052d81 with Priority: HIGHEST for action port [ 1026.194701] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.194857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.194949] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.195298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.195298] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3b4e2d2-bd4c-4aa0-be81-75c881b79d89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.196199] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.196280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.196362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.196572] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.199150] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.199621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.199998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.200216] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.200311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.200405] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3b4e2d2-bd4c-4aa0-be81-75c881b79d89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.201262] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-74f7b5cb-9129-46dc-8760-995c9c052d81 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.201382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74f7b5cb-9129-46dc-8760-995c9c052d81" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.201459] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74f7b5cb-9129-46dc-8760-995c9c052d81" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.201634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74f7b5cb-9129-46dc-8760-995c9c052d81" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.201817] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74f7b5cb-9129-46dc-8760-995c9c052d81',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.703090] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3b4e2d2-bd4c-4aa0-be81-75c881b79d89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.705484] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.705665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.706093] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74f7b5cb-9129-46dc-8760-995c9c052d81 with status ACTIVE [ 1026.706422] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.706560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.706560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.706756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.706838] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.707016] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.707112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.707192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.707339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.707408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.707573] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.707669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.707846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.707846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.707931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.708057] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74f7b5cb-9129-46dc-8760-995c9c052d81 is going to be updated. [ 1026.720955] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a709c207-f73f-472d-bc52-25ccd049c6fc in Status: SUCCESS [ 1026.721177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.730554] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.730685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.730765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.730955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.731099] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.731249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74f7b5cb-9129-46dc-8760-995c9c052d81" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.912122] env[69499]: INFO networking_nsxv3.common.synchronization [req-8907c918-1058-4567-8d6f-ecc99946c75b req-32357c76-44f5-4d40-b9a4-39fd1454fa22 tempest-ServersTestJSON-756379483 tempest-ServersTestJSON-756379483-project-member] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1026.912649] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1026.914382] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.914516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.914582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.914790] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.914944] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.915056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.915117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.915266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.915345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.915440] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.207871] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3b4e2d2-bd4c-4aa0-be81-75c881b79d89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.273166] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.273394] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.273511] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.273786] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.274054] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.274234] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.274389] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.274617] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.274772] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.274987] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.275121] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.275227] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.275383] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.275526] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.275599] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.275723] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.292376] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.292616] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1027.292697] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.292885] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.293213] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-347ca871-05b3-4d18-b37d-bd45b92f335e taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.293421] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-347ca871-05b3-4d18-b37d-bd45b92f335e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.293499] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-347ca871-05b3-4d18-b37d-bd45b92f335e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.293817] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-347ca871-05b3-4d18-b37d-bd45b92f335e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.293960] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('347ca871-05b3-4d18-b37d-bd45b92f335e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.421019] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.709743] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.709918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.709965] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.710265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.710350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.710405] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 is going to be created. [ 1027.736631] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.736769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.736814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.737040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.737458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.745547] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 in Status: UNINITIALIZED for 2s [ 1027.800029] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.800029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.800029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.800029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.800029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.800029] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 347ca871-05b3-4d18-b37d-bd45b92f335e not found, creating... [ 1027.800029] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.800029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.800029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.800029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.800029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.800716] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.800716] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.800716] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.800716] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.800716] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.800716] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 347ca871-05b3-4d18-b37d-bd45b92f335e is going to be created. [ 1027.823717] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.823946] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.824065] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.824335] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.824564] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.824786] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-347ca871-05b3-4d18-b37d-bd45b92f335e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.920643] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.423963] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.423963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.426481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.426481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.426481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.426481] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1028.457303] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.457582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.457736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.460034] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.460034] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.466058] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1028.616377] env[69499]: INFO networking_nsxv3.common.synchronization [req-8907c918-1058-4567-8d6f-ecc99946c75b req-629fa462-aa6a-4113-8706-6ae57a312f25 service nova] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_rules [ 1028.616377] env[69499]: INFO networking_nsxv3.common.synchronization [req-8907c918-1058-4567-8d6f-ecc99946c75b req-629fa462-aa6a-4113-8706-6ae57a312f25 service nova] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1028.616377] env[69499]: INFO networking_nsxv3.common.synchronization [req-8907c918-1058-4567-8d6f-ecc99946c75b req-629fa462-aa6a-4113-8706-6ae57a312f25 service nova] Enqueued Resource ID: 347ca871-05b3-4d18-b37d-bd45b92f335e with Priority: HIGHEST for action port [ 1028.616778] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_rules [ 1028.616916] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1028.617112] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 347ca871-05b3-4d18-b37d-bd45b92f335e with Priority: HIGHEST for action port [ 1028.617428] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.617552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.617650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.617818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.617896] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.618824] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.618959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.619202] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-347ca871-05b3-4d18-b37d-bd45b92f335e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.619358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-347ca871-05b3-4d18-b37d-bd45b92f335e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.619490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-347ca871-05b3-4d18-b37d-bd45b92f335e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.619662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-347ca871-05b3-4d18-b37d-bd45b92f335e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.619760] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('347ca871-05b3-4d18-b37d-bd45b92f335e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.121872] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.122043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.122251] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 347ca871-05b3-4d18-b37d-bd45b92f335e with status ACTIVE [ 1029.122430] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.122538] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.122600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.122825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.122919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.123108] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.123204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.123297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.123424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.123490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.123671] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.123763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.123823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.123959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.124044] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.124129] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 347ca871-05b3-4d18-b37d-bd45b92f335e is going to be updated. [ 1029.146315] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.146872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.146872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.146872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.146984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.147163] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-347ca871-05b3-4d18-b37d-bd45b92f335e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.756487] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 in Status: SUCCESS [ 1029.756850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.757218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.757449] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.757726] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.757922] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.758079] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.758398] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.758557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.758759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.759071] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3b4e2d2-bd4c-4aa0-be81-75c881b79d89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.262866] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3b4e2d2-bd4c-4aa0-be81-75c881b79d89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.477750] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1030.478158] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.478465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.478807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.480305] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.480305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.480305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.480305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.480305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.480305] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.764815] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3b4e2d2-bd4c-4aa0-be81-75c881b79d89: rpc.has_security_group_logging(os_id): False [ 1030.781606] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.781754] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.782198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.782198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.782305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.782479] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.782602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.782682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.782844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.782920] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.783034] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 is going to be created. [ 1030.838877] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.839039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.839078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.839307] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.840056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.857740] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 in Status: IN_PROGRESS for 2s [ 1030.982696] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.485184] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.564287] env[69499]: INFO networking_nsxv3.common.synchronization [req-722dac3a-4fe7-4ce8-b229-e28ad2f7ae81 req-3c6e1acd-a606-4577-86ee-42e2ba265e1b tempest-ServerMetadataTestJSON-1812772858 tempest-ServerMetadataTestJSON-1812772858-project-member] Enqueued Resource ID: a709c207-f73f-472d-bc52-25ccd049c6fc with Priority: HIGHEST for action security_group_members [ 1031.565123] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a709c207-f73f-472d-bc52-25ccd049c6fc with Priority: HIGHEST for action security_group_members [ 1031.565460] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a709c207-f73f-472d-bc52-25ccd049c6fc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.565588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.565672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.565917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.566100] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.566208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.566272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.566426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.566512] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.566608] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a709c207-f73f-472d-bc52-25ccd049c6fc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.987511] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.987866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.987866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.988031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.988094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.988197] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1032.013768] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.013932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.014075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.014453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.014522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.022648] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1032.069576] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.069761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.069969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.070614] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.070614] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.070614] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.070795] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.070795] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.071040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.071697] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.071697] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a709c207-f73f-472d-bc52-25ccd049c6fc is going to be updated. [ 1032.096985] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.097685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.097685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.097685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.097685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.105776] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a709c207-f73f-472d-bc52-25ccd049c6fc in Status: IN_PROGRESS for 2s [ 1032.871162] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 in Status: SUCCESS [ 1032.871662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.032599] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1034.035086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.035086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.035086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.035086] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.035086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.035086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.035086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.035086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.035086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.035086] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.114110] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a709c207-f73f-472d-bc52-25ccd049c6fc in Status: SUCCESS [ 1034.114250] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a709c207-f73f-472d-bc52-25ccd049c6fc deletion is rescheduled due to dependency. [ 1034.114365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a709c207-f73f-472d-bc52-25ccd049c6fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.425172] env[69499]: INFO networking_nsxv3.common.synchronization [req-1b56c1b2-06d8-4a41-9f17-c0338795049c req-9737cbf4-488d-40e3-9bef-82be6892cd01 tempest-ServerRescueTestJSONUnderV235-1666585610 tempest-ServerRescueTestJSONUnderV235-1666585610-project-member] Enqueued Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_members [ 1034.425339] env[69499]: INFO networking_nsxv3.common.synchronization [req-1b56c1b2-06d8-4a41-9f17-c0338795049c req-9737cbf4-488d-40e3-9bef-82be6892cd01 tempest-ServerRescueTestJSONUnderV235-1666585610 tempest-ServerRescueTestJSONUnderV235-1666585610-project-member] Enqueued Resource ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 with Priority: HIGHEST for action security_group_members [ 1034.425865] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_members [ 1034.425994] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 with Priority: HIGHEST for action security_group_members [ 1034.426300] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.426406] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.427087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.427087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.427087] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.427087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.427087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.427087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.427448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.427448] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.428089] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9a08c9-fc8b-4767-98d0-2ec770579da9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.428194] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.428259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.428467] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.428605] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.428695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.428766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.429063] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.429063] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.429063] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9a08c9-fc8b-4767-98d0-2ec770579da9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.474747] env[69499]: INFO networking_nsxv3.common.synchronization [req-1b56c1b2-06d8-4a41-9f17-c0338795049c req-9737cbf4-488d-40e3-9bef-82be6892cd01 tempest-ServerRescueTestJSONUnderV235-1666585610 tempest-ServerRescueTestJSONUnderV235-1666585610-project-member] Enqueued Resource ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 with Priority: HIGHEST for action security_group_rules [ 1034.474980] env[69499]: INFO networking_nsxv3.common.synchronization [req-1b56c1b2-06d8-4a41-9f17-c0338795049c req-9737cbf4-488d-40e3-9bef-82be6892cd01 tempest-ServerRescueTestJSONUnderV235-1666585610 tempest-ServerRescueTestJSONUnderV235-1666585610-project-member] Enqueued Resource ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 with Priority: HIGHEST for action security_group_members [ 1034.475150] env[69499]: INFO networking_nsxv3.common.synchronization [req-1b56c1b2-06d8-4a41-9f17-c0338795049c req-9737cbf4-488d-40e3-9bef-82be6892cd01 tempest-ServerRescueTestJSONUnderV235-1666585610 tempest-ServerRescueTestJSONUnderV235-1666585610-project-member] Enqueued Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_rules [ 1034.475288] env[69499]: INFO networking_nsxv3.common.synchronization [req-1b56c1b2-06d8-4a41-9f17-c0338795049c req-9737cbf4-488d-40e3-9bef-82be6892cd01 tempest-ServerRescueTestJSONUnderV235-1666585610 tempest-ServerRescueTestJSONUnderV235-1666585610-project-member] Enqueued Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_members [ 1034.475424] env[69499]: INFO networking_nsxv3.common.synchronization [req-1b56c1b2-06d8-4a41-9f17-c0338795049c req-9737cbf4-488d-40e3-9bef-82be6892cd01 tempest-ServerRescueTestJSONUnderV235-1666585610 tempest-ServerRescueTestJSONUnderV235-1666585610-project-member] Enqueued Resource ID: acce07e6-0920-45f4-beed-7e79cd48c175 with Priority: HIGHEST for action port [ 1034.475889] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 with Priority: HIGHEST for action security_group_rules [ 1034.476578] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_rules [ 1034.476842] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acce07e6-0920-45f4-beed-7e79cd48c175 with Priority: HIGHEST for action port [ 1034.476976] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 with Priority: HIGHEST for action security_group_members [ 1034.477277] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_members [ 1034.477748] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d9a08c9-fc8b-4767-98d0-2ec770579da9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.477888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.477957] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.478221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.478304] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d9a08c9-fc8b-4767-98d0-2ec770579da9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.479204] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.479304] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.479374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.479623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.479696] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.482399] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-acce07e6-0920-45f4-beed-7e79cd48c175 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.482511] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.483268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.483268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.483268] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acce07e6-0920-45f4-beed-7e79cd48c175',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.488891] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9a08c9-fc8b-4767-98d0-2ec770579da9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.488891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.488891] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.488891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.538607] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.538770] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.538843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.539083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.539256] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.539511] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.539511] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.539680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.539680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.540236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.540236] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.540236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.540236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.540236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.540396] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.540396] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.540454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.540818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.540818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.540818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.540818] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.931163] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.932080] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d9a08c9-fc8b-4767-98d0-2ec770579da9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.988441] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9a08c9-fc8b-4767-98d0-2ec770579da9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.988576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.988810] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.988921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.989060] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acce07e6-0920-45f4-beed-7e79cd48c175 with status ACTIVE [ 1034.989223] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.989361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.989404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.989623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.989727] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.989889] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.989988] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.990061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.990219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.990296] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.990483] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.990591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.990655] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.990798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.990872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.990956] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acce07e6-0920-45f4-beed-7e79cd48c175 is going to be updated. [ 1035.010549] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.010700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.010768] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.013053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.013053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.013053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.030804] env[69499]: INFO networking_nsxv3.common.synchronization [req-6c252d4d-9292-42c8-8874-96c0b6ab3054 req-dd3abdd1-219a-4b4b-acac-5af7d14cfc89 tempest-ServerRescueTestJSONUnderV235-1666585610 tempest-ServerRescueTestJSONUnderV235-1666585610-project-member] Enqueued Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_members [ 1035.030804] env[69499]: INFO networking_nsxv3.common.synchronization [req-6c252d4d-9292-42c8-8874-96c0b6ab3054 req-dd3abdd1-219a-4b4b-acac-5af7d14cfc89 tempest-ServerRescueTestJSONUnderV235-1666585610 tempest-ServerRescueTestJSONUnderV235-1666585610-project-member] Enqueued Resource ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 with Priority: HIGHEST for action security_group_members [ 1035.031035] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_members [ 1035.035471] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 with Priority: HIGHEST for action security_group_members [ 1035.036774] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.036911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.037282] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9a08c9-fc8b-4767-98d0-2ec770579da9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.037428] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.043277] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf01aae2-c409-4ed9-940b-99698ec3968f: rpc.has_security_group_logging(os_id): False [ 1035.062140] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.062223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.062300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.063126] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.063357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.063856] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.064619] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.064725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.065037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.065243] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.065470] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.066314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.066397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.066742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.066880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.067095] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.067328] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.067458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.067658] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.067766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.067937] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1035.138714] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.139152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.139236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.139547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.139720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.163840] env[69499]: INFO networking_nsxv3.common.synchronization [req-6c252d4d-9292-42c8-8874-96c0b6ab3054 req-dd3abdd1-219a-4b4b-acac-5af7d14cfc89 tempest-ServerRescueTestJSONUnderV235-1666585610 tempest-ServerRescueTestJSONUnderV235-1666585610-project-member] Enqueued Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_rules [ 1035.164030] env[69499]: INFO networking_nsxv3.common.synchronization [req-6c252d4d-9292-42c8-8874-96c0b6ab3054 req-dd3abdd1-219a-4b4b-acac-5af7d14cfc89 tempest-ServerRescueTestJSONUnderV235-1666585610 tempest-ServerRescueTestJSONUnderV235-1666585610-project-member] Enqueued Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_members [ 1035.164181] env[69499]: INFO networking_nsxv3.common.synchronization [req-6c252d4d-9292-42c8-8874-96c0b6ab3054 req-dd3abdd1-219a-4b4b-acac-5af7d14cfc89 tempest-ServerRescueTestJSONUnderV235-1666585610 tempest-ServerRescueTestJSONUnderV235-1666585610-project-member] Enqueued Resource ID: acce07e6-0920-45f4-beed-7e79cd48c175 with Priority: HIGHEST for action port [ 1035.165288] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1035.165665] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_rules [ 1035.165800] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_members [ 1035.165900] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acce07e6-0920-45f4-beed-7e79cd48c175 with Priority: HIGHEST for action port [ 1035.166591] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.166721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.166930] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.167032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.167218] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-acce07e6-0920-45f4-beed-7e79cd48c175 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.167388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.167388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.167658] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.167753] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acce07e6-0920-45f4-beed-7e79cd48c175',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.434438] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.439823] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d9a08c9-fc8b-4767-98d0-2ec770579da9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.674023] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acce07e6-0920-45f4-beed-7e79cd48c175 with status ACTIVE [ 1035.674023] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.674023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.674023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.674023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.674023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.674023] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.674023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.674023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.674023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.674023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.674023] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.674023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.674023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.674023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.674023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.674023] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acce07e6-0920-45f4-beed-7e79cd48c175 is going to be updated. [ 1035.693974] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.694380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.694541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.694822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.695068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.695322] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acce07e6-0920-45f4-beed-7e79cd48c175" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.936432] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.936645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.936786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.937063] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.937200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.937333] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 is going to be updated. [ 1035.941401] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.941616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.941709] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.941919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.941950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.942135] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 is going to be created. [ 1035.969201] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.969349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.969420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.969717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.969832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.971689] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.971796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.971909] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.972063] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.972183] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.982376] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 in Status: UNINITIALIZED for 2s [ 1035.982376] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: IN_PROGRESS for 2s [ 1037.177835] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1037.178325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.223014] env[69499]: INFO networking_nsxv3.common.synchronization [req-4819c524-4793-4758-bf5b-30e53e01432b req-907bd90b-7241-409f-babc-258819b970ce tempest-AttachVolumeTestJSON-2079313698 tempest-AttachVolumeTestJSON-2079313698-project-member] Enqueued Resource ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 with Priority: HIGHEST for action security_group_members [ 1037.223014] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 with Priority: HIGHEST for action security_group_members [ 1037.223014] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7f6a50-148b-4bd4-8db5-07c132b22182 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.223259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.223259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.223855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.223855] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.223855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.224698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.225745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.225745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.225745] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7f6a50-148b-4bd4-8db5-07c132b22182',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.729772] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.729933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.730016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.730244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.730337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.730533] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.731113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.731113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.731113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.731113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.731113] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 is going to be updated. [ 1037.757375] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.757546] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.757662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.757933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.758161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.767108] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 in Status: IN_PROGRESS for 2s [ 1037.992499] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: SUCCESS [ 1037.993101] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.993101] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.993243] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.993367] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.993510] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.993586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.993750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.993863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.993969] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.995634] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 in Status: SUCCESS [ 1037.995833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.999020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.999020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.999020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.999020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.999020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.999020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.999020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.999020] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9a08c9-fc8b-4767-98d0-2ec770579da9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.500773] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.503797] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.503797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.503797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.503797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.503797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.503797] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.503797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.503797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.503797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.503797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.503797] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 is going to be deleted. [ 1038.535290] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.535290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.535290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.535632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.539018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.539018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.539018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.539018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.539018] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.539554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.539656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.539837] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.539944] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.540069] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9a08c9-fc8b-4767-98d0-2ec770579da9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.005762] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.042467] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.045230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.045230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.045230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.045230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.045418] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.045555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.045629] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.045808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.046482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.046482] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 already deleted. [ 1039.046482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.046482] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d9a08c9-fc8b-4767-98d0-2ec770579da9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.048048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.048048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.048048] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.048048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.048048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.048048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.048394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.048394] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9a08c9-fc8b-4767-98d0-2ec770579da9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.517016] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.517016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.517016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.517016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.517016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.517016] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 is going to be updated. [ 1039.545760] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.545936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.546007] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.546233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.546417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.550760] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d9a08c9-fc8b-4767-98d0-2ec770579da9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.552564] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.552564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.552564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.553028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.553028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.553914] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.553914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.553914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.553914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.553914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.553914] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 already deleted. [ 1039.553914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.554856] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: IN_PROGRESS for 2s [ 1039.776696] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 in Status: SUCCESS [ 1039.776696] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 deletion is rescheduled due to dependency. [ 1039.776696] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.062307] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d9a08c9-fc8b-4767-98d0-2ec770579da9: rpc.has_security_group_logging(os_id): False [ 1040.079122] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.079364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.079498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.080354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.080354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.080354] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.080354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.080354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.080566] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.080596] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.080720] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 is going to be created. [ 1040.101026] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/8d9a08c9-fc8b-4767-98d0-2ec770579da9], does not exist path=[/infra/domains/default/groups/8d9a08c9-fc8b-4767-98d0-2ec770579da9]."\n}' [ 1040.101162] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8d9a08c9-fc8b-4767-98d0-2ec770579da9 [ 1040.101217] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1040.142091] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.142286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.142429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.142931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.148135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.148135] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.148135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.148135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.148135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.148135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.148135] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.148135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.148135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.148135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.148135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.148135] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d9a08c9-fc8b-4767-98d0-2ec770579da9 is going to be created. [ 1040.174141] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/8d9a08c9-fc8b-4767-98d0-2ec770579da9], does not exist path=[/infra/domains/default/groups/8d9a08c9-fc8b-4767-98d0-2ec770579da9]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8d9a08c9-fc8b-4767-98d0-2ec770579da9 [ 1040.174141] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d9a08c9-fc8b-4767-98d0-2ec770579da9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.174141] env[69499]: Traceback (most recent call last): [ 1040.174141] env[69499]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1040.174141] env[69499]: return func(*args, **kwargs) [ 1040.174141] env[69499]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1040.174141] env[69499]: res.raise_for_status() [ 1040.174141] env[69499]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1040.174141] env[69499]: raise HTTPError(http_error_msg, response=self) [ 1040.174141] env[69499]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8d9a08c9-fc8b-4767-98d0-2ec770579da9 [ 1040.174141] env[69499]: During handling of the above exception, another exception occurred: [ 1040.174141] env[69499]: Traceback (most recent call last): [ 1040.174141] env[69499]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1040.174141] env[69499]: listener.cb(fileno) [ 1040.174141] env[69499]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1040.174141] env[69499]: result = function(*args, **kwargs) [ 1040.174141] env[69499]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1040.174141] env[69499]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1040.174141] env[69499]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1040.174141] env[69499]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1040.174141] env[69499]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1040.174141] env[69499]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1040.174141] env[69499]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1040.174141] env[69499]: res.raise_for_status() [ 1040.174141] env[69499]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1040.174141] env[69499]: raise HTTPError(http_error_msg, response=self) [ 1040.174141] env[69499]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8d9a08c9-fc8b-4767-98d0-2ec770579da9 [ 1040.174141] env[69499]: Removing descriptor: 65 [ 1040.972037] env[69499]: INFO networking_nsxv3.common.synchronization [req-a8272685-2689-4c00-a9b0-f21b81742bde req-3a1e4e94-9f19-4aa4-a728-dff70d7f50e5 tempest-ServerRescueTestJSONUnderV235-1666585610 tempest-ServerRescueTestJSONUnderV235-1666585610-project-member] Enqueued Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_members [ 1040.973040] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 with Priority: HIGHEST for action security_group_members [ 1040.973040] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.973884] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.401563] env[69499]: INFO networking_nsxv3.common.synchronization [req-98348d28-f6c3-42ff-b76d-be2edf0021eb req-daa957b7-62c7-4c10-aca1-a79a4e4e1da4 tempest-ServerRescueNegativeTestJSON-106874270 tempest-ServerRescueNegativeTestJSON-106874270-project-member] Enqueued Resource ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce with Priority: HIGHEST for action security_group_members [ 1041.402405] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce with Priority: HIGHEST for action security_group_members [ 1041.402405] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.402405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.402405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.402598] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.402756] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.402849] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.402912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.403090] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.403177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.403270] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b43d2067-f3a1-4ba4-a448-6e853d1bb2ce',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.568481] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: SUCCESS [ 1041.568816] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.568881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.569361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.569361] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.569473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.569473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.569618] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.569710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.569791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.569888] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.570728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.570890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.571148] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.571261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.571329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.571478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.571555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.571640] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.905629] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.905931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.905931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.906184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.929077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.929332] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.929450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.929518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.929780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.929866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.929999] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce is going to be updated. [ 1041.955219] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.955381] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.955431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.955652] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.955793] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.964590] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce in Status: IN_PROGRESS for 2s [ 1042.073054] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.073504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.073504] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.073658] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.073803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.074067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.093708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.093980] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.094115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.094183] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.094387] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.094470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.094561] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 is going to be updated. [ 1042.118693] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.118832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.118943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.119131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.119270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.126740] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: IN_PROGRESS for 2s [ 1042.927717] env[69499]: INFO networking_nsxv3.common.synchronization [req-925f8664-e073-47c8-a24a-ce32119a1456 req-e722d506-d50a-4378-9a08-c66114200cea tempest-ServersTestJSON-756379483 tempest-ServersTestJSON-756379483-project-member] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1042.930367] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1042.930367] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.930367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.930367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.930367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.930367] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.930367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.930367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.930367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.930367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.930367] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.433498] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.936077] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.973597] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce in Status: SUCCESS [ 1043.973766] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce deletion is rescheduled due to dependency. [ 1043.973824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.135826] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: SUCCESS [ 1044.136684] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 deletion is rescheduled due to dependency. [ 1044.136684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.136684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.136684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.136893] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.137019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.137087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.137771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.137771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.137771] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.438343] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.438641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.438641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.439915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.439915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.439915] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1044.465595] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.465595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.465595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.465797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.465941] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.474297] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1044.640230] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.641337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.641337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.641337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.641337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.641556] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.641673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.641900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.641900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.641987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.642139] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 is going to be updated. [ 1044.665244] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.665385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.665448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.665643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.665784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.674469] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: IN_PROGRESS for 2s [ 1046.483615] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1046.483615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.688462] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: SUCCESS [ 1046.688556] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 deletion is rescheduled due to dependency. [ 1046.689339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.689339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.689339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.689504] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.689562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.689638] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.689834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.689942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.690084] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.192996] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.193185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.193258] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.193481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.193572] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.193778] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.193878] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.193942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.194115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.194193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.194281] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 is going to be updated. [ 1047.222319] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.222518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.222587] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.222823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.222978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.235312] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: IN_PROGRESS for 2s [ 1047.929947] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1047.930168] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1049.246402] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: SUCCESS [ 1049.246799] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 deletion is rescheduled due to dependency. [ 1049.246799] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.246967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.247207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.247418] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.247558] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.247628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.247796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.247881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.247969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.248147] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-a75c8cf2-8281-4188-a659-235b2c49d8f3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.248245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.248307] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.248451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.248590] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.248685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.248746] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.248882] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.248955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.249046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.249133] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.752737] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a75c8cf2-8281-4188-a659-235b2c49d8f3: rpc.has_security_group_logging(os_id): False [ 1049.770083] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.770268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.770325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.770509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.770696] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.771059] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.771059] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.771059] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.771281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.771281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.771497] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.771563] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.771733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.771914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.771997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.772207] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.772640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.772640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.772640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.772640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.772640] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 is going to be updated. [ 1049.900642] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.900917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.900986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.901237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.901413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.913523] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: IN_PROGRESS for 2s [ 1051.928465] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 in Status: SUCCESS [ 1051.928760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.928867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.929105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.929188] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a75c8cf2-8281-4188-a659-235b2c49d8f3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.460714] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.460866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.460940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.461166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.461267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.461371] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a75c8cf2-8281-4188-a659-235b2c49d8f3 is going to be deleted. [ 1052.508594] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.508934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.508934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.509046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.509127] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.509246] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a75c8cf2-8281-4188-a659-235b2c49d8f3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.930694] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1052.931090] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1053.229071] env[69499]: INFO networking_nsxv3.common.synchronization [req-3fcb21ac-f350-4f8d-9195-f208211fd697 req-df2af0bf-31a4-4a64-b7d2-dbf9754cb30f tempest-ServerRescueNegativeTestJSON-106874270 tempest-ServerRescueNegativeTestJSON-106874270-project-member] Enqueued Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_members [ 1053.230031] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_members [ 1053.230031] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-478dd7f8-67f8-49a4-9685-e070fbf463f1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.230220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.230220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.230643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.230643] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.231503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.231503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.231503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.231503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.231503] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.732707] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.799909] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.800076] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.800187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.800359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.800462] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.873171] env[69499]: INFO networking_nsxv3.common.synchronization [req-32fc00a6-2367-464b-b084-c8ff1c4daa44 req-15ddeab7-a095-4c1f-88ff-48fcf9f8542b tempest-ServersTestJSON-756379483 tempest-ServersTestJSON-756379483-project-member] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1053.873304] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1053.873595] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.873721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.873787] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.873986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.874708] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.874829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.874898] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.875082] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.875233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.875332] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.166618] env[69499]: INFO networking_nsxv3.common.synchronization [req-9167af9f-480a-4b62-9907-0f6225bdf110 req-24243fe0-8e7b-47d8-bb23-58cf1258dd80 tempest-ServerDiskConfigTestJSON-146039362 tempest-ServerDiskConfigTestJSON-146039362-project-member] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 1054.168071] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 1054.169543] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.169981] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.171091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.171091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.171091] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.171091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.171091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.171091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.171091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.171091] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.235379] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.307141] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.313318] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.313522] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.313686] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.313962] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.314652] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.314845] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.314982] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.315566] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.315746] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.316028] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.316166] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.316243] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.316380] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.316496] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.316572] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.316741] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.334766] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.334950] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1054.335130] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.335317] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.335700] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-92dd7d35-bfa3-4f1b-a4d0-099784f4983f taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.335887] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-92dd7d35-bfa3-4f1b-a4d0-099784f4983f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.336023] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-92dd7d35-bfa3-4f1b-a4d0-099784f4983f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.336356] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-92dd7d35-bfa3-4f1b-a4d0-099784f4983f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.336514] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92dd7d35-bfa3-4f1b-a4d0-099784f4983f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.379755] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.675976] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.676158] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.676232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.676451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.695855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.696147] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.696271] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.696337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.696537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.696669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.696723] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be updated. [ 1054.721553] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.721733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.721777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.721964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.722120] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.728996] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 1054.737626] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.737626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.737626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.737897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.737897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.737982] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 is going to be updated. [ 1054.775915] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.776062] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.776105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.777019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.777019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.788238] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 in Status: IN_PROGRESS for 2s [ 1054.809897] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.840625] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.840947] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.841133] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.841442] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.841597] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.841899] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 92dd7d35-bfa3-4f1b-a4d0-099784f4983f not found, creating... [ 1054.842154] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.842227] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.842296] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.842525] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.842671] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.842959] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.843203] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.843277] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.843473] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.843612] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.843754] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 92dd7d35-bfa3-4f1b-a4d0-099784f4983f is going to be created. [ 1054.864262] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.864552] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.864709] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.864857] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.865123] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.865438] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-92dd7d35-bfa3-4f1b-a4d0-099784f4983f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.881738] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.312559] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1055.312897] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1055.385099] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.385099] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.385099] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.385099] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.385361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.385361] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1055.422757] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.422910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.422979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.423217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.423355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.431817] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1055.575318] env[69499]: INFO networking_nsxv3.common.synchronization [req-32fc00a6-2367-464b-b084-c8ff1c4daa44 req-d4eb8381-e4bd-4f36-866d-babe9751971a service nova] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_rules [ 1055.575318] env[69499]: INFO networking_nsxv3.common.synchronization [req-32fc00a6-2367-464b-b084-c8ff1c4daa44 req-d4eb8381-e4bd-4f36-866d-babe9751971a service nova] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1055.575318] env[69499]: INFO networking_nsxv3.common.synchronization [req-32fc00a6-2367-464b-b084-c8ff1c4daa44 req-d4eb8381-e4bd-4f36-866d-babe9751971a service nova] Enqueued Resource ID: 92dd7d35-bfa3-4f1b-a4d0-099784f4983f with Priority: HIGHEST for action port [ 1055.575318] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_rules [ 1055.575318] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1055.575318] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92dd7d35-bfa3-4f1b-a4d0-099784f4983f with Priority: HIGHEST for action port [ 1055.575318] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.575318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.575318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.576075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.576368] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.578531] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.578661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.578894] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-92dd7d35-bfa3-4f1b-a4d0-099784f4983f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.578996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92dd7d35-bfa3-4f1b-a4d0-099784f4983f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.579075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92dd7d35-bfa3-4f1b-a4d0-099784f4983f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.579264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92dd7d35-bfa3-4f1b-a4d0-099784f4983f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.579335] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92dd7d35-bfa3-4f1b-a4d0-099784f4983f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.081507] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.081635] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.081846] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92dd7d35-bfa3-4f1b-a4d0-099784f4983f with status ACTIVE [ 1056.082101] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.082544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.082544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.082544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.082544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.082772] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.082831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.082875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.082997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.083144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.083448] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.083448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.083448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.083555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.083639] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.083724] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92dd7d35-bfa3-4f1b-a4d0-099784f4983f is going to be updated. [ 1056.109144] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.109295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.109295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.109470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.109596] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.109811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92dd7d35-bfa3-4f1b-a4d0-099784f4983f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.145485] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.145642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.145683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.145834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.158735] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1056.159551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.160407] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1056.273058] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.273235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.273235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.273441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.283581] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.284237] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1056.284320] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.284413] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1056.323932] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.323932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.323932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.323932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.324905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.325082] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1056.390762] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.391018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.391018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.391364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.391472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.391702] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1056.459355] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.459557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.459687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.459945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.460319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.460700] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1056.460841] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'8593ab1f-869e-4abc-aa58-bb57de585b7e', '5d0e4115-ee30-417b-a8e4-6acc1ae30669', '9e2f7750-c289-4805-83a2-f0930a638e2e', 'e3b4e2d2-bd4c-4aa0-be81-75c881b79d89', 'c134d579-1162-46e0-bee7-73f3403c9135', 'b43d2067-f3a1-4ba4-a448-6e853d1bb2ce', 'f00aea48-dae0-47aa-a96c-f017c0721f54', '137495f6-8f3c-475d-b71c-88971c3781de', 'cf01aae2-c409-4ed9-940b-99698ec3968f', '645b270d-e6d4-4f84-872d-3c097c5f4722', '1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea', '1159257b-8ed6-4ac4-9971-8ad543ef43f9', 'ed300e57-2eef-458b-9bd5-cd62d0872060', '11b16049-e77a-4319-a5c3-228658ee669e', '2b5ab2a6-a426-4cab-ae0e-330b8062bbf5', '717f63b4-82e8-4749-8d24-1abe7790389b', 'fd1b70ed-24ca-4742-b6ba-0af6127fef74', '6a7f6a50-148b-4bd4-8db5-07c132b22182', '31a7bec7-75f3-4780-ac90-0f2f7e7744e9', '94d2e4ea-db97-4a0c-91d6-635a39a38e5c', '1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5', '10e373b9-4e6a-452b-b0ab-03e94d0ab90a', '032cabed-a789-4100-95a3-6e4998fdb5cc', 'ffce52a9-70af-448f-a2c4-9791dde804d4', '547a2dde-952d-4847-b831-1393133e5c28', 'a240c519-0037-4bca-bd0c-b35068bcd700', '478dd7f8-67f8-49a4-9685-e070fbf463f1', '8579ac1e-c68a-42fa-957e-e205942d2fbc', '99e9e6e3-beeb-4449-ad6b-772723544abd', 'a709c207-f73f-472d-bc52-25ccd049c6fc', '04847a44-8459-4dcc-b6cd-80a364fba3d0', '35e560ef-ae12-4b78-9fd4-fb9be25e66dd', 'bfb7458a-4a70-45c1-acb5-648c53b6821a', 'd2b93818-38bc-46b2-af63-51d39fce766c', '13d987c8-57de-4cf5-acd3-eb580bd10337', '29ac832b-134e-49c9-ac8a-2171fbc0640f', '2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc', '3b269f87-89e9-484d-8baa-02ac9f5f2e89', '44133d71-0f30-4e7f-9c96-2491812bcd1f', 'dba52dd6-05d0-4283-ba0e-107ad8c10157', 'f140365e-2848-4938-ba34-06e4b21ec256', 'f909dc53-3f94-4644-a89e-154a39dd9695', '68bf910a-7d9f-4466-9028-7ab38c7fc30d', 'c0fc2518-1857-49ca-8dcd-c34aaa8c5c22', '39342f68-f184-4c9d-a63b-6e7eb4959f38', '2a81501c-f74a-48d9-97d5-db6c60895c60'} {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.460943] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1056.478609] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.478609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.478791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.478923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.479053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.479195] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1056.479294] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.479392] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1056.552636] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.552936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.552936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.553089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.554163] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.554417] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1056.554493] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.554564] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1056.554632] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1056.554710] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1056.554784] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGH for action security_group_rules [ 1056.554861] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 with Priority: HIGH for action security_group_rules [ 1056.554929] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e2f7750-c289-4805-83a2-f0930a638e2e with Priority: HIGH for action security_group_rules [ 1056.555014] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGH for action security_group_rules [ 1056.555076] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGH for action security_group_rules [ 1056.555137] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce with Priority: HIGH for action security_group_rules [ 1056.555199] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGH for action security_group_rules [ 1056.555255] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGH for action security_group_rules [ 1056.555323] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGH for action security_group_rules [ 1056.555384] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGH for action security_group_rules [ 1056.555438] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea with Priority: HIGH for action security_group_rules [ 1056.555501] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGH for action security_group_rules [ 1056.555567] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed300e57-2eef-458b-9bd5-cd62d0872060 with Priority: HIGH for action security_group_rules [ 1056.555644] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11b16049-e77a-4319-a5c3-228658ee669e with Priority: HIGH for action security_group_rules [ 1056.555715] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGH for action security_group_rules [ 1056.555780] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGH for action security_group_rules [ 1056.555880] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGH for action security_group_rules [ 1056.555943] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 with Priority: HIGH for action security_group_rules [ 1056.556008] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGH for action security_group_rules [ 1056.556074] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGH for action security_group_rules [ 1056.556168] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.737926] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 1056.738124] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 deletion is rescheduled due to dependency. [ 1056.738236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.795594] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 in Status: SUCCESS [ 1056.795794] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.441511] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1057.441845] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.441890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.442113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.442300] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.442417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.442482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.442647] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.442824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.442824] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.945404] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.447641] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.949550] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.949723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.949811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.950068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.950142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.950241] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1058.976794] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.976931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.976983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.977192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.977329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.984895] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1059.264010] env[69499]: INFO networking_nsxv3.common.synchronization [req-d92b4c6a-d3eb-44a2-94ef-8f504c3f3634 req-278d6d6e-65cf-4f92-9d8e-d7e9869d98a8 tempest-ServerDiskConfigTestJSON-146039362 tempest-ServerDiskConfigTestJSON-146039362-project-member] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 1059.264552] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 1059.264690] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e with Priority: HIGH for action security_group_rules [ 1059.264791] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2f7750-c289-4805-83a2-f0930a638e2e with Priority: HIGH for action security_group_rules [ 1059.264885] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f00aea48-dae0-47aa-a96c-f017c0721f54 with Priority: HIGH for action security_group_rules [ 1059.264977] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGH for action security_group_rules [ 1059.265083] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c with Priority: HIGH for action security_group_rules [ 1059.267018] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGH for action security_group_rules [ 1059.267018] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 with Priority: HIGH for action security_group_rules [ 1059.267018] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGH for action security_group_rules [ 1059.267018] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11b16049-e77a-4319-a5c3-228658ee669e with Priority: HIGH for action security_group_rules [ 1059.267018] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGH for action security_group_rules [ 1059.267018] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed300e57-2eef-458b-9bd5-cd62d0872060 with Priority: HIGH for action security_group_rules [ 1059.267018] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 with Priority: HIGH for action security_group_rules [ 1059.267018] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea with Priority: HIGH for action security_group_rules [ 1059.267018] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 with Priority: HIGH for action security_group_rules [ 1059.267018] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGH for action security_group_rules [ 1059.267018] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce with Priority: HIGH for action security_group_rules [ 1059.269152] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137495f6-8f3c-475d-b71c-88971c3781de with Priority: HIGH for action security_group_rules [ 1059.269309] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c134d579-1162-46e0-bee7-73f3403c9135 with Priority: HIGH for action security_group_rules [ 1059.269467] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 with Priority: HIGH for action security_group_rules [ 1059.269515] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGH for action security_group_rules [ 1059.269956] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.270096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.270170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.270359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.270512] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.270652] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.270720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.270815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.273844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.273844] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.273844] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8593ab1f-869e-4abc-aa58-bb57de585b7e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.273844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.273844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.273844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.273844] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8593ab1f-869e-4abc-aa58-bb57de585b7e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.274118] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e2f7750-c289-4805-83a2-f0930a638e2e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.274118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.274195] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.274344] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.274413] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e2f7750-c289-4805-83a2-f0930a638e2e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.275141] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f00aea48-dae0-47aa-a96c-f017c0721f54 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.275248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.275311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.275458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.275526] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f00aea48-dae0-47aa-a96c-f017c0721f54',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.276594] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.276714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.276832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.277024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.277024] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b5ab2a6-a426-4cab-ae0e-330b8062bbf5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.278702] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.278702] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.278702] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.278702] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.278702] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94d2e4ea-db97-4a0c-91d6-635a39a38e5c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.278954] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.278954] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.279072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.280431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.280431] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.280431] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a7f6a50-148b-4bd4-8db5-07c132b22182 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.280431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.280431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.280431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.280431] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a7f6a50-148b-4bd4-8db5-07c132b22182',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.281235] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.281386] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.281472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.281626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.281695] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd1b70ed-24ca-4742-b6ba-0af6127fef74',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.282353] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11b16049-e77a-4319-a5c3-228658ee669e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.282450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.282515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.282737] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.282737] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11b16049-e77a-4319-a5c3-228658ee669e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.283503] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.283619] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.283672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.283822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.284012] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.284552] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed300e57-2eef-458b-9bd5-cd62d0872060 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.284657] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.284723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.284907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.284984] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed300e57-2eef-458b-9bd5-cd62d0872060',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.285644] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.285742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.285811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.285959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.286039] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1159257b-8ed6-4ac4-9971-8ad543ef43f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.286828] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.286983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.286983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.287134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.287205] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.287855] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-645b270d-e6d4-4f84-872d-3c097c5f4722 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.287962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.288089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.288252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.288326] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('645b270d-e6d4-4f84-872d-3c097c5f4722',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.289320] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.289320] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.289320] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.289578] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.289578] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.289578] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.289925] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b43d2067-f3a1-4ba4-a448-6e853d1bb2ce',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.293112] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-137495f6-8f3c-475d-b71c-88971c3781de taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.293112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.293112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.293112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.293112] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('137495f6-8f3c-475d-b71c-88971c3781de',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.294461] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c134d579-1162-46e0-bee7-73f3403c9135 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.294591] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.294649] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.294822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.294889] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c134d579-1162-46e0-bee7-73f3403c9135',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.295548] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d0e4115-ee30-417b-a8e4-6acc1ae30669 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.295656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.295723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.295873] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.295948] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d0e4115-ee30-417b-a8e4-6acc1ae30669',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.296626] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.296731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.296788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.296946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.296996] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3b4e2d2-bd4c-4aa0-be81-75c881b79d89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.569583] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.569942] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.569942] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.570250] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.570521] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.570678] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.570798] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.571030] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.571182] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.571399] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.571511] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.571624] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.571736] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.572312] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.572312] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.572312] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.596422] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.596626] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1059.596774] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.596969] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-122" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.597352] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-1475e85c-0dd6-4c47-86cd-7a08a30f237b taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.597540] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-1475e85c-0dd6-4c47-86cd-7a08a30f237b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.597667] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-1475e85c-0dd6-4c47-86cd-7a08a30f237b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.598046] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-1475e85c-0dd6-4c47-86cd-7a08a30f237b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.598206] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1475e85c-0dd6-4c47-86cd-7a08a30f237b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.766077] env[69499]: INFO networking_nsxv3.common.synchronization [req-9f52312e-4e8b-41c0-8a0f-bdc56bbcd202 req-6e4eeaad-2b00-43ab-9dd9-f981e548c50a tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1059.766734] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1059.767189] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.767340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.767442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.768450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.768450] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.768450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.768450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.768450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.768764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.768764] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.811625] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.811768] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.811887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.812178] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.813722] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.813883] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.813980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.814199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.814368] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.814536] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.814589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.814717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.814806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.814890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.814978] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b5ab2a6-a426-4cab-ae0e-330b8062bbf5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.818442] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.818554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.818618] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.818927] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.819228] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.819228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.819403] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.819470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.819563] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.819714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.819827] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.822027] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd1b70ed-24ca-4742-b6ba-0af6127fef74 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.822207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.822207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.822384] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.822533] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.822629] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.822814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.822875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.822962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.823058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.823201] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd1b70ed-24ca-4742-b6ba-0af6127fef74',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.835368] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.835533] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.835574] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.835829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.836078] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.836188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.836254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.836450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.836510] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.836583] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.836668] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3b4e2d2-bd4c-4aa0-be81-75c881b79d89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.866048] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.866265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.867095] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.867202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.876173] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.876173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.876504] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.876504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.877198] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.877300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.878035] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.878140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.879177] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.879289] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.880047] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.880149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.880907] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.881046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.882437] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.882547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.883211] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.883730] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.883825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.884735] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.885251] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.885251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.885872] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.888022] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.888236] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.888347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.888412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.888604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.888695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.888779] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be updated. [ 1059.890387] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.890604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.892058] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.892192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.892972] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.893170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.893597] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.894010] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.894116] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.909682] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.910214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.910397] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8593ab1f-869e-4abc-aa58-bb57de585b7e is going to be deleted. [ 1059.911487] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.911690] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.918916] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.918916] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.918916] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.918916] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.918916] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.926345] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 1059.939222] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.939272] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94d2e4ea-db97-4a0c-91d6-635a39a38e5c is going to be deleted. [ 1059.940292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.940519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.961419] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.961995] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d0e4115-ee30-417b-a8e4-6acc1ae30669 is going to be deleted. [ 1059.963996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.964230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.971555] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.971735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.984338] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.984464] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.988689] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.988809] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f00aea48-dae0-47aa-a96c-f017c0721f54 is going to be deleted. [ 1059.989774] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.989959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.008137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.008250] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c134d579-1162-46e0-bee7-73f3403c9135 is going to be deleted. [ 1060.009117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.009265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.027344] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.027457] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.032758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.033128] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11b16049-e77a-4319-a5c3-228658ee669e is going to be deleted. [ 1060.034149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.034398] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.071597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.071747] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 645b270d-e6d4-4f84-872d-3c097c5f4722 is going to be deleted. [ 1060.072662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.072919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.086707] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.086707] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.100827] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.101150] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.101301] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.101626] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.101801] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.101964] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 1475e85c-0dd6-4c47-86cd-7a08a30f237b not found, creating... [ 1060.102286] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.102412] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.102533] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.102772] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.102946] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.103262] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.103471] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.103599] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.103817] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.103956] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.104173] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 1475e85c-0dd6-4c47-86cd-7a08a30f237b is going to be created. [ 1060.130801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.130888] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a7f6a50-148b-4bd4-8db5-07c132b22182 is going to be deleted. [ 1060.131689] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.131870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.133506] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.133689] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.133813] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.134061] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.134286] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.134518] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-1475e85c-0dd6-4c47-86cd-7a08a30f237b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.135917] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.136057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.159445] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.159629] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.159793] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.160062] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.160323] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.160484] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.160603] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.160820] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.160962] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.161183] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.161322] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.161437] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.161545] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.161657] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.161770] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.161907] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.176992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.177117] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e2f7750-c289-4805-83a2-f0930a638e2e is going to be deleted. [ 1060.177928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.178114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.186088] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.186224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.190829] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.190985] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1060.191137] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.191298] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.191564] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-e58eaa0f-622a-46c1-9096-b5d6b018f56c taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.191723] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-e58eaa0f-622a-46c1-9096-b5d6b018f56c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.191844] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-e58eaa0f-622a-46c1-9096-b5d6b018f56c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.192152] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-e58eaa0f-622a-46c1-9096-b5d6b018f56c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.192300] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e58eaa0f-622a-46c1-9096-b5d6b018f56c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.217967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.218086] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1159257b-8ed6-4ac4-9971-8ad543ef43f9 is going to be deleted. [ 1060.218817] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.219018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.223161] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.223257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.270667] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.270822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.297350] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.297350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.304882] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.304978] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b43d2067-f3a1-4ba4-a448-6e853d1bb2ce is going to be deleted. [ 1060.305834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.306071] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.326591] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.327432] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b5ab2a6-a426-4cab-ae0e-330b8062bbf5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.330753] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd1b70ed-24ca-4742-b6ba-0af6127fef74',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.343400] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3b4e2d2-bd4c-4aa0-be81-75c881b79d89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.344945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.345074] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea is going to be deleted. [ 1060.346191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.346366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.418317] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.418480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.419294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.419413] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 137495f6-8f3c-475d-b71c-88971c3781de is going to be deleted. [ 1060.420335] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.420538] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.424801] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.425131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.445083] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.445193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.474400] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.474506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.505405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.505544] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed300e57-2eef-458b-9bd5-cd62d0872060 is going to be deleted. [ 1060.506452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.506707] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.506834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.506951] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be deleted. [ 1060.507738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.507924] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.508049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.508221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8593ab1f-869e-4abc-aa58-bb57de585b7e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.508725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.508889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.508965] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.509096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94d2e4ea-db97-4a0c-91d6-635a39a38e5c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.509525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.509680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.509820] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.509942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d0e4115-ee30-417b-a8e4-6acc1ae30669" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.510099] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.510231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.510309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.510420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f00aea48-dae0-47aa-a96c-f017c0721f54" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.510544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.510690] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.510786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.510904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c134d579-1162-46e0-bee7-73f3403c9135" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.511049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.511196] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.511270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.511377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11b16049-e77a-4319-a5c3-228658ee669e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.511503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.511641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.511715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.511826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-645b270d-e6d4-4f84-872d-3c097c5f4722" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.511941] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.512111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.512188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.512393] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.512491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.512539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.512682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.512754] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.512836] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 already deleted. [ 1060.512913] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.513054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.513195] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.513268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.513375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a7f6a50-148b-4bd4-8db5-07c132b22182" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.513497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.513633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.513705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.513811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e2f7750-c289-4805-83a2-f0930a638e2e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.513933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.514085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.514155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.514271] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b43d2067-f3a1-4ba4-a448-6e853d1bb2ce" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.514394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.514531] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.514603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.514709] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1159257b-8ed6-4ac4-9971-8ad543ef43f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.514827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.514964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.515096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.515157] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d5ae41d-74ea-459f-a3a8-3f6d921ed0ea" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.556182] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.556364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.556431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.556631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.556719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.556837] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-137495f6-8f3c-475d-b71c-88971c3781de" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.621245] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.621631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.621631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.621762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.621857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.622058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed300e57-2eef-458b-9bd5-cd62d0872060" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.628275] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1060.628719] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.628840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.628908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.629093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.629172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.629283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.694646] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.694883] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.695321] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.695705] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.695905] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.696117] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port e58eaa0f-622a-46c1-9096-b5d6b018f56c not found, creating... [ 1060.696405] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.696656] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.696799] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.697138] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.697344] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.697662] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.697840] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.697970] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.698211] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.698352] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.698499] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: e58eaa0f-622a-46c1-9096-b5d6b018f56c is going to be created. [ 1060.727312] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.727561] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.727720] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.728029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.728291] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.728568] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-e58eaa0f-622a-46c1-9096-b5d6b018f56c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.791286] env[69499]: INFO networking_nsxv3.common.synchronization [req-d92b4c6a-d3eb-44a2-94ef-8f504c3f3634 req-1c546981-1591-4d18-91fb-d6b1853c9dc6 service nova] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_rules [ 1060.791483] env[69499]: INFO networking_nsxv3.common.synchronization [req-d92b4c6a-d3eb-44a2-94ef-8f504c3f3634 req-1c546981-1591-4d18-91fb-d6b1853c9dc6 service nova] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 1060.791537] env[69499]: INFO networking_nsxv3.common.synchronization [req-d92b4c6a-d3eb-44a2-94ef-8f504c3f3634 req-1c546981-1591-4d18-91fb-d6b1853c9dc6 service nova] Enqueued Resource ID: 1475e85c-0dd6-4c47-86cd-7a08a30f237b with Priority: HIGHEST for action port [ 1060.791761] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_rules [ 1060.791891] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 1060.791987] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1475e85c-0dd6-4c47-86cd-7a08a30f237b with Priority: HIGHEST for action port [ 1060.792542] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.792653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.792722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.792924] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.793009] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.794253] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.794353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.794550] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-1475e85c-0dd6-4c47-86cd-7a08a30f237b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.794664] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1475e85c-0dd6-4c47-86cd-7a08a30f237b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.794723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1475e85c-0dd6-4c47-86cd-7a08a30f237b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.794877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1475e85c-0dd6-4c47-86cd-7a08a30f237b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.794965] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1475e85c-0dd6-4c47-86cd-7a08a30f237b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.829257] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5: rpc.has_security_group_logging(os_id): False [ 1060.830373] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 717f63b4-82e8-4749-8d24-1abe7790389b: rpc.has_security_group_logging(os_id): False [ 1060.832876] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd1b70ed-24ca-4742-b6ba-0af6127fef74: rpc.has_security_group_logging(os_id): False [ 1060.846460] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.846590] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.846658] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.846858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.847675] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3b4e2d2-bd4c-4aa0-be81-75c881b79d89: rpc.has_security_group_logging(os_id): False [ 1060.861024] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.861139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.861863] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.861959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.872324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.872584] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.872664] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.872733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.872918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.872998] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.873102] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be updated. [ 1060.874055] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.874231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.875522] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.875616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.892362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.892606] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.892698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.892759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.892919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.893007] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.893105] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 is going to be updated. [ 1060.893973] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.894160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.925927] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.926084] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.926183] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.926224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.926384] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.926465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.926545] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 is going to be updated. [ 1060.927475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.927643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.948768] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.949080] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.949201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.949270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.949460] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.949541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.949632] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 is going to be updated. [ 1060.973394] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.973577] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.973614] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.973912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.974094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.978035] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.978035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.978035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.978232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.978262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.001831] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1061.003492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.003492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.003492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.003492] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.003492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.003492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.003492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.003492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.003492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.003492] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.016431] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 2s [ 1061.019317] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 in Status: IN_PROGRESS for 2s [ 1061.039323] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.039493] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.039535] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.039968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.040075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.068669] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.068985] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.069062] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.069305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.069497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.089463] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 in Status: IN_PROGRESS for 2s [ 1061.112178] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 in Status: IN_PROGRESS for 2s [ 1061.295463] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.295651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.296944] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1475e85c-0dd6-4c47-86cd-7a08a30f237b with status ACTIVE [ 1061.297146] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.297269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.297330] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.297544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.297633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.297807] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.297903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.297961] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.298124] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.298201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.298380] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.298470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.298524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.298665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.298738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.298820] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1475e85c-0dd6-4c47-86cd-7a08a30f237b is going to be updated. [ 1061.320290] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.320470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.320531] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.320673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.320835] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.320990] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1475e85c-0dd6-4c47-86cd-7a08a30f237b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.492498] env[69499]: INFO networking_nsxv3.common.synchronization [req-9f52312e-4e8b-41c0-8a0f-bdc56bbcd202 req-6ce64ae5-b7d4-4bf1-a391-1f859723849b service nova] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_rules [ 1061.492588] env[69499]: INFO networking_nsxv3.common.synchronization [req-9f52312e-4e8b-41c0-8a0f-bdc56bbcd202 req-6ce64ae5-b7d4-4bf1-a391-1f859723849b service nova] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1061.492708] env[69499]: INFO networking_nsxv3.common.synchronization [req-9f52312e-4e8b-41c0-8a0f-bdc56bbcd202 req-6ce64ae5-b7d4-4bf1-a391-1f859723849b service nova] Enqueued Resource ID: e58eaa0f-622a-46c1-9096-b5d6b018f56c with Priority: HIGHEST for action port [ 1061.495523] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_rules [ 1061.495523] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1061.495523] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58eaa0f-622a-46c1-9096-b5d6b018f56c with Priority: HIGHEST for action port [ 1061.495523] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.495523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.495523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.495523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.495523] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.496148] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.496148] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.496148] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.496356] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.496859] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.496859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.496859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.497104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.497104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.497712] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.498640] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e58eaa0f-622a-46c1-9096-b5d6b018f56c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.498780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e58eaa0f-622a-46c1-9096-b5d6b018f56c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.498857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e58eaa0f-622a-46c1-9096-b5d6b018f56c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.499523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e58eaa0f-622a-46c1-9096-b5d6b018f56c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.499643] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e58eaa0f-622a-46c1-9096-b5d6b018f56c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.505935] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.506143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.506223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.506456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.506661] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.506854] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.506918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.507073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.507197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.507335] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.507548] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.507679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.507775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.507956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.508158] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.508299] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.508347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.508530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.508633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.508733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.509023] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.936251] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 1061.936843] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 deletion is rescheduled due to dependency. [ 1061.936843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.936843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.936980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.937106] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.937223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.937317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.937515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.937609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.937794] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.001283] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.001416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.001605] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.002871] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e58eaa0f-622a-46c1-9096-b5d6b018f56c with status ACTIVE [ 1062.003083] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.003203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.003272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.003477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.003565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.003743] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.003845] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.003969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.004086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.004167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.004349] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.004444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.004504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.004645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.004722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.004806] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e58eaa0f-622a-46c1-9096-b5d6b018f56c is going to be updated. [ 1062.010929] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf01aae2-c409-4ed9-940b-99698ec3968f: rpc.has_security_group_logging(os_id): False [ 1062.026240] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.026240] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.026240] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.026240] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.026240] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.026472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e58eaa0f-622a-46c1-9096-b5d6b018f56c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.028042] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.028042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.028042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.028042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.043991] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.044259] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.044518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.044518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.044648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.044744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.044947] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.045066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.045128] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.045286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.045365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.045551] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.045655] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.045716] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.045859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.045951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.046051] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1062.126045] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.126045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.126045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.126045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.126045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.137618] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1062.440224] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.507095] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.942267] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.008983] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.009163] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.009202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.009451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.009556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.009598] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be created. [ 1063.039019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.039019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.039019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.039019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.039019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.039562] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1063.039807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.040536] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 in Status: SUCCESS [ 1063.040730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.047525] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: UNINITIALIZED for 2s [ 1063.115862] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 in Status: SUCCESS [ 1063.116088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.126751] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 in Status: SUCCESS [ 1063.126989] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.444429] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.444588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.444659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.444875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.444968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.445082] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be updated. [ 1063.488780] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.488780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.488780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.489019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.489150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.497314] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 1064.039890] env[69499]: INFO networking_nsxv3.common.synchronization [req-fc7ea7ea-a1bd-4506-8f71-6340b2d5e4a2 req-b7196e18-2382-4259-93ee-9c8a43698cc8 tempest-ServerActionsTestJSON-629709431 tempest-ServerActionsTestJSON-629709431-project-member] Enqueued Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 1064.043217] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 1064.043217] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.043217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.043217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.043217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.043217] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.043217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.043217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.043217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.043217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.043217] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.180125] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1064.180391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.180594] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.180901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.181034] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.546110] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.546314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.546414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.546703] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.568418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.568655] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.568767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.568847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.569046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.569143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.569247] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 is going to be updated. [ 1064.592870] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.593029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.593108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.593306] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.593457] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.601938] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: IN_PROGRESS for 2s [ 1064.683751] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.683936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.683986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.684247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.684425] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.684532] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.684595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.684752] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.684840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.684934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.685072] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.025254] env[69499]: INFO networking_nsxv3.common.synchronization [req-7f3712ac-8ff3-4018-a45e-27b273e7a4a7 req-5a91ef5d-c6cf-4859-a9b6-46921a9e2db9 tempest-ServersTestJSON-756379483 tempest-ServersTestJSON-756379483-project-member] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1065.026027] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1065.026143] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.026264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.026323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.026614] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.026744] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.026862] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.026939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.027121] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.027180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.027264] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.056602] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1065.057049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.057049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.057818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.057818] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.057818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.057818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.057818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.058086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.058086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.058086] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.187652] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.187850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.507983] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 1065.507983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.507983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.507983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.507983] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.507983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.508367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.508367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.508367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.508367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.508483] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.529109] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.560485] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.560652] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.560726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.560985] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.561183] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.561291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.561358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.561525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.561610] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.561743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.561859] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.561932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.561988] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.562160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.562299] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.562389] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.562451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.562590] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.562665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.562745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.562830] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.011344] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.012023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.012023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.012023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.012279] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.012426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.012464] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.012663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.012861] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.013071] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.013134] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.013193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.013265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.013437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.013596] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.013708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.013783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.013944] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.014039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.014140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.014250] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.030599] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.064960] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4968c8b1-e03b-4720-ad0c-9445bc9427b6: rpc.has_security_group_logging(os_id): False [ 1066.085836] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.086076] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.086076] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.086346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.086498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.086657] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.086806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.086806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.086974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.087049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.087230] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.087327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.087385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.087525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.087605] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.087823] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.087900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.087964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.088160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.088237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.088283] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be created. [ 1066.179737] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.179938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.180031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.180296] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.180506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.191628] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1066.518029] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31a7bec7-75f3-4780-ac90-0f2f7e7744e9: rpc.has_security_group_logging(os_id): False [ 1066.532653] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.532798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.532872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.533104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.533197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.533298] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1066.535471] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.535640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.535683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.535812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.535896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.536104] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.536203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.536269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.536413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.536544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.536668] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.536761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.536825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.536968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.537054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.537227] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.537321] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.537383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.537522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.537596] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.537679] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be created. [ 1066.557599] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.557790] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.557959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.558160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.558301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.565507] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1066.591185] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.591185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.591185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.591185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.591185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.603869] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 1066.610685] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: SUCCESS [ 1066.610943] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 deletion is rescheduled due to dependency. [ 1066.611102] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.030205] env[69499]: INFO networking_nsxv3.common.synchronization [req-e84642d7-8d7d-47f9-8fff-8c09085922eb req-1c40d056-09ca-4440-8191-d2927336d8fa tempest-ServerRescueNegativeTestJSON-106874270 tempest-ServerRescueNegativeTestJSON-106874270-project-member] Enqueued Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_members [ 1067.030758] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 with Priority: HIGHEST for action security_group_members [ 1067.031117] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-478dd7f8-67f8-49a4-9685-e070fbf463f1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.031210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.031283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.031486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.031641] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.031741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.031803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.031951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.032045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.032135] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('478dd7f8-67f8-49a4-9685-e070fbf463f1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.535417] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.535417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.535417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.535417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.554184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.554446] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.554767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.554877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.555092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.555181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.555311] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 is going to be updated. [ 1067.576366] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.576492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.576587] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.576740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.576877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.583504] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 in Status: IN_PROGRESS for 2s [ 1068.205768] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1068.206071] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.575585] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1068.575898] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.575940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.576162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.576348] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.576463] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.576529] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.576670] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.576750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.576832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.577021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.577091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.577167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.577269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.577400] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.577488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.577541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.577673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.577793] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.577911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.578018] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.616503] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 1068.616667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.080184] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf01aae2-c409-4ed9-940b-99698ec3968f: rpc.has_security_group_logging(os_id): False [ 1069.097731] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.097937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.098030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.098250] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.098412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.098569] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.098619] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.098719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.098831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.098907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.099119] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.099214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.099279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.099420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.099491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.099678] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.099769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.099827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.100021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.100098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.100183] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1069.159167] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.159300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.159399] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.159578] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.160196] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.173862] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1069.593115] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 in Status: SUCCESS [ 1069.593115] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478dd7f8-67f8-49a4-9685-e070fbf463f1 deletion is rescheduled due to dependency. [ 1069.593115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478dd7f8-67f8-49a4-9685-e070fbf463f1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.198118] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1071.198854] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.721018] env[69499]: INFO networking_nsxv3.common.synchronization [req-c8e5ae86-04ac-45da-a724-d98a1d9ed9bd req-dd15cc33-1a70-46d0-a8ea-14ef38ef40ec tempest-ServerDiskConfigTestJSON-146039362 tempest-ServerDiskConfigTestJSON-146039362-project-member] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 1071.721018] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGHEST for action security_group_members [ 1071.721018] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.721018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.721018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.721018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.721018] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.721018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.721432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.721672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.721838] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.722017] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.226452] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.226452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.226452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.226823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.226823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.227146] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.227146] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.227146] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.227312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.227340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.227448] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be updated. [ 1072.254784] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.254942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.255033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.255226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.255362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.264139] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: IN_PROGRESS for 2s [ 1073.757687] env[69499]: INFO networking_nsxv3.common.synchronization [req-5954db40-4828-496f-8641-de2a059440fe req-f698779f-dc3f-4fd0-a6ba-ec816bc2581a tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1073.759441] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1073.759845] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.760041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.760145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.760354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.762745] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.762745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.762745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.762745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.762745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.762745] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.264560] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.264711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.264782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.265010] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.265108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.265293] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.265408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.265470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.265619] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.266696] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.266696] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1074.279227] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 in Status: SUCCESS [ 1074.279484] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 deletion is rescheduled due to dependency. [ 1074.279618] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.299415] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.299415] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.299569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.300259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.300259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.308877] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1074.326342] env[69499]: INFO networking_nsxv3.common.synchronization [req-d7cde51a-0a29-4e05-b12f-df996dfc22b3 req-9566c3e1-d252-4f82-87d9-4127cab1896f tempest-ServerActionsTestJSON-629709431 tempest-ServerActionsTestJSON-629709431-project-member] Enqueued Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 1074.326467] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 1074.326846] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.326962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.327242] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.328036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.328163] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.328286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.328459] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.328662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.328764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.328891] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.831834] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.832131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.832131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.832324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.832409] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.832627] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.832712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.832773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.832926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.833012] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.833116] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 is going to be updated. [ 1074.859632] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.860211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.860211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.860211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.860360] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.869139] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: IN_PROGRESS for 2s [ 1075.433283] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-76 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.433504] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.433642] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.433954] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.434252] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.434444] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.434596] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.434846] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.437269] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.437269] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.437269] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.437269] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.437269] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.437269] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.437269] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.437269] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.455056] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.455245] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1075.455389] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.455566] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.455886] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-02a7cb11-dc38-46c0-9248-cc05438d45f0 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.456085] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-02a7cb11-dc38-46c0-9248-cc05438d45f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.456211] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-02a7cb11-dc38-46c0-9248-cc05438d45f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.456548] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-02a7cb11-dc38-46c0-9248-cc05438d45f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.456685] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02a7cb11-dc38-46c0-9248-cc05438d45f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.668407] env[69499]: INFO networking_nsxv3.common.synchronization [req-60cd4d20-843a-44ae-bded-bbc79370e2a8 req-4f039ef5-7085-49da-8e7b-6fc3baa48d14 tempest-ServersTestJSON-1975233753 tempest-ServersTestJSON-1975233753-project-member] Enqueued Resource ID: ffce52a9-70af-448f-a2c4-9791dde804d4 with Priority: HIGHEST for action security_group_members [ 1075.669137] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffce52a9-70af-448f-a2c4-9791dde804d4 with Priority: HIGHEST for action security_group_members [ 1075.669651] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffce52a9-70af-448f-a2c4-9791dde804d4 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.669841] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.670152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.670152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.670387] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.670568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.670666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.670921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.671048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.671180] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffce52a9-70af-448f-a2c4-9791dde804d4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.962097] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.962097] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.962526] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.962526] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.962713] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.962836] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 02a7cb11-dc38-46c0-9248-cc05438d45f0 not found, creating... [ 1075.963162] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.963325] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.963443] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.963670] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.963807] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.965412] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.965412] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.965412] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.965412] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.965412] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.965412] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 02a7cb11-dc38-46c0-9248-cc05438d45f0 is going to be created. [ 1075.989190] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.989428] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.989558] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.989829] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.990114] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.990352] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-02a7cb11-dc38-46c0-9248-cc05438d45f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.000527] env[69499]: INFO networking_nsxv3.common.synchronization [req-cb86d4c2-2adc-4456-833e-13f50d91c339 req-c24f27f5-a0d2-4b8f-ad8b-0eb1bd7cd91f tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGHEST for action security_group_members [ 1076.000782] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGHEST for action security_group_members [ 1076.001395] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.001522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.001589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.001779] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.001936] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.003131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.003243] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.003412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.003677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.003832] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3b4e2d2-bd4c-4aa0-be81-75c881b79d89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.173762] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.173915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.173915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.174824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.205132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.205132] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.205132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.205132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.205132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.205132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.205132] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffce52a9-70af-448f-a2c4-9791dde804d4 is going to be updated. [ 1076.233732] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.233732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.233732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.233964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.233964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.242574] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffce52a9-70af-448f-a2c4-9791dde804d4 in Status: IN_PROGRESS for 2s [ 1076.318781] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1076.318927] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 deletion is rescheduled due to dependency. [ 1076.319067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.507348] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.507502] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.507581] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.507818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.507928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.508166] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.508271] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.508335] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.508499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.508646] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.508646] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 is going to be updated. [ 1076.539612] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.539731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.539892] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.540154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.540355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.551217] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 in Status: IN_PROGRESS for 2s [ 1076.749496] env[69499]: INFO networking_nsxv3.common.synchronization [req-d7cde51a-0a29-4e05-b12f-df996dfc22b3 req-11ab1d5f-a89b-494d-a697-3e6b5f89f2d4 service nova] Enqueued Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_rules [ 1076.749691] env[69499]: INFO networking_nsxv3.common.synchronization [req-d7cde51a-0a29-4e05-b12f-df996dfc22b3 req-11ab1d5f-a89b-494d-a697-3e6b5f89f2d4 service nova] Enqueued Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 1076.749834] env[69499]: INFO networking_nsxv3.common.synchronization [req-d7cde51a-0a29-4e05-b12f-df996dfc22b3 req-11ab1d5f-a89b-494d-a697-3e6b5f89f2d4 service nova] Enqueued Resource ID: 02a7cb11-dc38-46c0-9248-cc05438d45f0 with Priority: HIGHEST for action port [ 1076.750112] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_rules [ 1076.750249] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 1076.750350] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02a7cb11-dc38-46c0-9248-cc05438d45f0 with Priority: HIGHEST for action port [ 1076.750912] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.751060] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.751162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.751417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.751551] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.754103] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.754223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.754433] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-02a7cb11-dc38-46c0-9248-cc05438d45f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.754537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02a7cb11-dc38-46c0-9248-cc05438d45f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.754604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02a7cb11-dc38-46c0-9248-cc05438d45f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.754860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02a7cb11-dc38-46c0-9248-cc05438d45f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.754860] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02a7cb11-dc38-46c0-9248-cc05438d45f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.877198] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: SUCCESS [ 1076.877380] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 deletion is rescheduled due to dependency. [ 1076.877492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.877645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.877852] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.878041] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.878157] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.878221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.878373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.878455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.878548] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.069020] env[69499]: INFO networking_nsxv3.common.synchronization [req-c23ac3c9-632b-45bf-87db-e8d4cbcc0fe1 req-3bc5e501-9a53-4b97-be70-509e730a6e29 tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 with Priority: HIGHEST for action security_group_members [ 1077.069310] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 with Priority: HIGHEST for action security_group_members [ 1077.070106] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b269f87-89e9-484d-8baa-02ac9f5f2e89 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.070257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.070415] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.070527] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.070683] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.070786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.070849] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.071014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.071126] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.071210] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b269f87-89e9-484d-8baa-02ac9f5f2e89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.259221] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.259221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.259221] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02a7cb11-dc38-46c0-9248-cc05438d45f0 with status ACTIVE [ 1077.259221] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.259221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.259221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.259221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.259221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.259221] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.259221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.259221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.259221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.259221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.259221] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.259915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.259915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.259915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.259915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.259915] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02a7cb11-dc38-46c0-9248-cc05438d45f0 is going to be updated. [ 1077.295232] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.295232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.295232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.295232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.295232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.295232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02a7cb11-dc38-46c0-9248-cc05438d45f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.350843] env[69499]: INFO networking_nsxv3.common.synchronization [req-a2e1e318-9c7b-4756-999a-241a29c04fa8 req-ac7150dd-0fae-4c6f-af1a-84ae3fde6840 tempest-ServersTestJSON-756379483 tempest-ServersTestJSON-756379483-project-member] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1077.351432] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1077.352489] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.352489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.352489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.352489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.352677] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.352737] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.352776] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.352928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.353026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.353124] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.381241] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.573304] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.573480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.573739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.573739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.593047] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.593307] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.593433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.593499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.593698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.593784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.593875] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 is going to be updated. [ 1077.653323] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.653461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.653551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.653762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.653904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.663912] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 in Status: IN_PROGRESS for 2s [ 1077.694304] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.694500] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.694632] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.694914] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.695191] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.695450] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.695483] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.695676] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.695826] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.696047] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.696197] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.696309] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.696421] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.696537] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.696646] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.696780] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.720204] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.720377] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1077.720502] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.720672] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.720955] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-76ec7316-8303-41ca-bd04-9f873e042ca4 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.721140] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-76ec7316-8303-41ca-bd04-9f873e042ca4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.721254] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-76ec7316-8303-41ca-bd04-9f873e042ca4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.721555] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-76ec7316-8303-41ca-bd04-9f873e042ca4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.721696] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76ec7316-8303-41ca-bd04-9f873e042ca4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.856305] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.883579] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.224813] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.225176] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.225255] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.225538] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.225716] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.225880] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 76ec7316-8303-41ca-bd04-9f873e042ca4 not found, creating... [ 1078.226193] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.226373] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.226512] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.226843] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.227043] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.227317] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.227783] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.227783] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.227972] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.228196] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.228363] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 76ec7316-8303-41ca-bd04-9f873e042ca4 is going to be created. [ 1078.253921] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffce52a9-70af-448f-a2c4-9791dde804d4 in Status: SUCCESS [ 1078.254113] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffce52a9-70af-448f-a2c4-9791dde804d4 deletion is rescheduled due to dependency. [ 1078.254232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.260233] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.260504] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.260578] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.260848] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.261083] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.261317] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-76ec7316-8303-41ca-bd04-9f873e042ca4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.358727] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.387086] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.387086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.387086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.387086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.387086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.387337] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 is going to be updated. [ 1078.444877] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.444877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.444877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.444877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.444877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.463943] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: IN_PROGRESS for 2s [ 1078.571547] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 in Status: SUCCESS [ 1078.571547] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 deletion is rescheduled due to dependency. [ 1078.571547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.861435] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.861777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.861951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.862267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.863349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.863349] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1078.887397] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.887548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.887604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.887805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.887971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.895864] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1078.951273] env[69499]: INFO networking_nsxv3.common.synchronization [req-a2e1e318-9c7b-4756-999a-241a29c04fa8 req-ce2d790a-96aa-48e6-b590-13e0ac9d8a60 service nova] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_rules [ 1078.955248] env[69499]: INFO networking_nsxv3.common.synchronization [req-a2e1e318-9c7b-4756-999a-241a29c04fa8 req-ce2d790a-96aa-48e6-b590-13e0ac9d8a60 service nova] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1078.955248] env[69499]: INFO networking_nsxv3.common.synchronization [req-a2e1e318-9c7b-4756-999a-241a29c04fa8 req-ce2d790a-96aa-48e6-b590-13e0ac9d8a60 service nova] Enqueued Resource ID: 76ec7316-8303-41ca-bd04-9f873e042ca4 with Priority: HIGHEST for action port [ 1078.955248] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_rules [ 1078.955248] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1078.955248] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ec7316-8303-41ca-bd04-9f873e042ca4 with Priority: HIGHEST for action port [ 1078.955248] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.955248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.955248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.955248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.955248] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.955248] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.955248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.955248] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-76ec7316-8303-41ca-bd04-9f873e042ca4 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.955248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76ec7316-8303-41ca-bd04-9f873e042ca4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.955248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76ec7316-8303-41ca-bd04-9f873e042ca4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.955248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76ec7316-8303-41ca-bd04-9f873e042ca4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.955248] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76ec7316-8303-41ca-bd04-9f873e042ca4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.458472] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.458762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.461278] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76ec7316-8303-41ca-bd04-9f873e042ca4 with status ACTIVE [ 1079.462536] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.463040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.463040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.463298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.463393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.463629] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.463702] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.463762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.463993] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.464077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.465277] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.465277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.465277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.465277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.465277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.465277] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76ec7316-8303-41ca-bd04-9f873e042ca4 is going to be updated. [ 1079.485109] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.485109] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.485109] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.485272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.485347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.485498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76ec7316-8303-41ca-bd04-9f873e042ca4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.674577] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 in Status: SUCCESS [ 1079.674748] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b269f87-89e9-484d-8baa-02ac9f5f2e89 deletion is rescheduled due to dependency. [ 1079.674864] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b269f87-89e9-484d-8baa-02ac9f5f2e89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.475066] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: SUCCESS [ 1080.475394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.475428] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.475675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.475849] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.475963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.476043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.476194] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.476276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.476362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.476455] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.907468] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1080.907714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.911516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.911749] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.911943] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.912082] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.912150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.912307] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.912583] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.912583] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.981197] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.414717] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.483875] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0fc2518-1857-49ca-8dcd-c34aaa8c5c22: rpc.has_security_group_logging(os_id): False [ 1081.504135] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.504325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.504404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.504700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.504805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.505162] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.505310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.505392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.505739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.505866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.505984] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 is going to be updated. [ 1081.580787] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.580983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.581139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.581355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.581503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.594316] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: IN_PROGRESS for 2s [ 1081.919486] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.422420] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.422686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.422791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.423048] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.423214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.423358] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1082.450763] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.450985] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.451640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.451640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.451640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.462089] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1083.608910] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: SUCCESS [ 1083.609260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.953165] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1083.953301] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1084.471791] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1084.472037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.472225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.472540] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.472743] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.472866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.472950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.473142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.473227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.473378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.473471] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.977937] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.978379] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.978379] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.978452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.978651] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.978741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.978805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.978912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.979031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.979122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.979273] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.979366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.979424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.979569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.979728] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.979814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.979876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.980016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.980094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.980200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.980308] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.412395] env[69499]: INFO networking_nsxv3.common.synchronization [None req-65956f9a-1e5f-4036-bb08-e3fb62b9b363 None None] Enqueued Resource ID: 566fbfe1-78b7-48ab-823b-42ebd227cfac with Priority: HIGHEST for action port [ 1085.413046] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 566fbfe1-78b7-48ab-823b-42ebd227cfac with Priority: HIGHEST for action port [ 1085.413492] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-566fbfe1-78b7-48ab-823b-42ebd227cfac taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.413616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-566fbfe1-78b7-48ab-823b-42ebd227cfac" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.413616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-566fbfe1-78b7-48ab-823b-42ebd227cfac" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.414706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-566fbfe1-78b7-48ab-823b-42ebd227cfac" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.414706] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('566fbfe1-78b7-48ab-823b-42ebd227cfac',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.485905] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf01aae2-c409-4ed9-940b-99698ec3968f: rpc.has_security_group_logging(os_id): False [ 1085.505026] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.505026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.505026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.505026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.505026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.505026] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.505026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.505026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.505026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.505506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.505506] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.505506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.505506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.505653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.506283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.506283] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.506283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.506283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.506519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.506519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.506641] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1085.599225] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.599490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.599626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.599958] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.601802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.619983] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1085.717949] env[69499]: INFO networking_nsxv3.common.synchronization [None req-c7e6cad9-dc22-451a-8728-13ae521d82fb tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 54331bd8-45ec-4f27-a691-e602cc0be614 with Priority: HIGHEST for action security_group_rules [ 1085.717949] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54331bd8-45ec-4f27-a691-e602cc0be614 with Priority: HIGHEST for action security_group_rules [ 1085.718696] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54331bd8-45ec-4f27-a691-e602cc0be614 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.718888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.718997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.719781] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.719781] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54331bd8-45ec-4f27-a691-e602cc0be614',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.826114] env[69499]: INFO networking_nsxv3.common.synchronization [None req-2eeee9a2-70e3-48f2-80fa-4d0e53098f86 tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 54331bd8-45ec-4f27-a691-e602cc0be614 with Priority: HIGHEST for action security_group_rules [ 1085.826114] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54331bd8-45ec-4f27-a691-e602cc0be614 with Priority: HIGHEST for action security_group_rules [ 1085.826114] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54331bd8-45ec-4f27-a691-e602cc0be614 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.826114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.916959] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 566fbfe1-78b7-48ab-823b-42ebd227cfac [ 1085.917282] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.917443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.917523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.917748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.917857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.917948] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:566fbfe1-78b7-48ab-823b-42ebd227cfac already deleted. [ 1085.918053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-566fbfe1-78b7-48ab-823b-42ebd227cfac" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.239666] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.239985] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.239985] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.240139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.240319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.240433] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54331bd8-45ec-4f27-a691-e602cc0be614 already deleted. [ 1086.240520] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.240678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.240844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.240931] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54331bd8-45ec-4f27-a691-e602cc0be614',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.759967] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.760267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.760379] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.760665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.760830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.760947] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54331bd8-45ec-4f27-a691-e602cc0be614 already deleted. [ 1086.761094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.637033] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1087.637327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.951387] env[69499]: INFO networking_nsxv3.common.synchronization [None req-3b7059fc-68d1-4735-9ac4-a5f777350752 None None] Enqueued Resource ID: 50cee105-024b-4ac4-9a67-6e7ca62a7c20 with Priority: HIGHEST for action port [ 1087.951387] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50cee105-024b-4ac4-9a67-6e7ca62a7c20 with Priority: HIGHEST for action port [ 1087.951968] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-50cee105-024b-4ac4-9a67-6e7ca62a7c20 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.952138] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50cee105-024b-4ac4-9a67-6e7ca62a7c20" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.952611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50cee105-024b-4ac4-9a67-6e7ca62a7c20" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.952611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50cee105-024b-4ac4-9a67-6e7ca62a7c20" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.952611] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50cee105-024b-4ac4-9a67-6e7ca62a7c20',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.137789] env[69499]: INFO networking_nsxv3.common.synchronization [None req-30c1958c-d313-49b8-af25-4b1fe9620203 None None] Enqueued Resource ID: 8a89dd40-4f3d-4397-9862-08c0ebfba129 with Priority: HIGHEST for action port [ 1088.138486] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a89dd40-4f3d-4397-9862-08c0ebfba129 with Priority: HIGHEST for action port [ 1088.138790] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a89dd40-4f3d-4397-9862-08c0ebfba129 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.138955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a89dd40-4f3d-4397-9862-08c0ebfba129" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.139044] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a89dd40-4f3d-4397-9862-08c0ebfba129" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.139276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a89dd40-4f3d-4397-9862-08c0ebfba129" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.139383] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a89dd40-4f3d-4397-9862-08c0ebfba129',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.454996] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50cee105-024b-4ac4-9a67-6e7ca62a7c20 [ 1088.455287] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.455452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.455515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.455851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.455851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.455958] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50cee105-024b-4ac4-9a67-6e7ca62a7c20 already deleted. [ 1088.456016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50cee105-024b-4ac4-9a67-6e7ca62a7c20" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.643027] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a89dd40-4f3d-4397-9862-08c0ebfba129 [ 1088.643027] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.643027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.643027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.643027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.643027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.643461] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a89dd40-4f3d-4397-9862-08c0ebfba129 already deleted. [ 1088.643461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a89dd40-4f3d-4397-9862-08c0ebfba129" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.306965] env[69499]: INFO networking_nsxv3.common.synchronization [req-e1ded1a1-c1b9-4e22-a18a-4e701eeea8b6 req-e7a65dcd-10b1-4ce3-b8eb-5a7889f4ab90 tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGHEST for action security_group_members [ 1090.307876] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGHEST for action security_group_members [ 1090.308828] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.309677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.309782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.310109] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.310528] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.310703] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.310823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.311107] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.311255] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.311397] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b5ab2a6-a426-4cab-ae0e-330b8062bbf5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.491476] env[69499]: INFO networking_nsxv3.common.synchronization [None req-90a34ebf-27ca-4e6c-99c9-ea4f0a9cc634 None None] Enqueued Resource ID: 6b5e7731-4153-4e75-a6a6-82d806a7f88c with Priority: HIGHEST for action port [ 1090.491476] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5e7731-4153-4e75-a6a6-82d806a7f88c with Priority: HIGHEST for action port [ 1090.491476] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b5e7731-4153-4e75-a6a6-82d806a7f88c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.491476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b5e7731-4153-4e75-a6a6-82d806a7f88c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.491476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b5e7731-4153-4e75-a6a6-82d806a7f88c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.496165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b5e7731-4153-4e75-a6a6-82d806a7f88c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.496165] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b5e7731-4153-4e75-a6a6-82d806a7f88c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.814210] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.814402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.814479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.814712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.814806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.815007] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.815114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.815178] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.815362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.815412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.815499] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 is going to be updated. [ 1090.845017] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.845017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.845017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.845017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.845017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.851993] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 in Status: IN_PROGRESS for 2s [ 1090.997314] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b5e7731-4153-4e75-a6a6-82d806a7f88c [ 1090.997562] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.997690] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.997753] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.997973] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.998079] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.998176] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b5e7731-4153-4e75-a6a6-82d806a7f88c already deleted. [ 1090.998273] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b5e7731-4153-4e75-a6a6-82d806a7f88c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.863551] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 in Status: SUCCESS [ 1092.863909] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 deletion is rescheduled due to dependency. [ 1092.863909] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.515302] env[69499]: INFO networking_nsxv3.common.synchronization [req-5e214f87-ba72-489e-a23c-35a2b82f0d01 req-47d6e8a2-bfe5-4919-82b2-1ffd27db6e32 tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 54331bd8-45ec-4f27-a691-e602cc0be614 with Priority: HIGHEST for action security_group_members [ 1094.515867] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54331bd8-45ec-4f27-a691-e602cc0be614 with Priority: HIGHEST for action security_group_members [ 1094.516307] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-54331bd8-45ec-4f27-a691-e602cc0be614 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.516307] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.516487] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.516627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.516791] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.516939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.517033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.517200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.517289] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.517373] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54331bd8-45ec-4f27-a691-e602cc0be614',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.809716] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.809919] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.810112] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.810537] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.810787] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.811016] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.811155] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.811751] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.811751] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.811751] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1094.811915] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1094.812008] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1094.812126] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1094.812240] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1094.812358] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1094.812541] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1094.830471] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1094.830659] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1094.830798] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1094.830966] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.831290] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-6c8434e7-f0c0-4289-8c3c-b211730f79ef taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.831515] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-6c8434e7-f0c0-4289-8c3c-b211730f79ef" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.831652] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-6c8434e7-f0c0-4289-8c3c-b211730f79ef" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.831958] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-6c8434e7-f0c0-4289-8c3c-b211730f79ef" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.832119] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c8434e7-f0c0-4289-8c3c-b211730f79ef',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.021713] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.021931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.021931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.022164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.022257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.022457] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.022562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.022629] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.022807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.022888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.022976] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54331bd8-45ec-4f27-a691-e602cc0be614 already deleted. [ 1095.023069] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.334853] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.335203] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.335467] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.335894] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.336252] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.336473] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 6c8434e7-f0c0-4289-8c3c-b211730f79ef not found, creating... [ 1095.336897] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.337189] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.337417] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.337781] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.338058] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.338552] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.338825] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.339056] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.339407] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.339661] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.339918] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 6c8434e7-f0c0-4289-8c3c-b211730f79ef is going to be created. [ 1095.359373] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.359696] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.359844] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.360142] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.360428] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.360684] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-6c8434e7-f0c0-4289-8c3c-b211730f79ef" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.075395] env[69499]: INFO networking_nsxv3.common.synchronization [req-5e214f87-ba72-489e-a23c-35a2b82f0d01 req-dc5ec468-01ca-4648-8393-8025f8118e7f service nova] Enqueued Resource ID: 54331bd8-45ec-4f27-a691-e602cc0be614 with Priority: HIGHEST for action security_group_rules [ 1096.075665] env[69499]: INFO networking_nsxv3.common.synchronization [req-5e214f87-ba72-489e-a23c-35a2b82f0d01 req-dc5ec468-01ca-4648-8393-8025f8118e7f service nova] Enqueued Resource ID: 54331bd8-45ec-4f27-a691-e602cc0be614 with Priority: HIGHEST for action security_group_members [ 1096.075711] env[69499]: INFO networking_nsxv3.common.synchronization [req-5e214f87-ba72-489e-a23c-35a2b82f0d01 req-dc5ec468-01ca-4648-8393-8025f8118e7f service nova] Enqueued Resource ID: 6c8434e7-f0c0-4289-8c3c-b211730f79ef with Priority: HIGHEST for action port [ 1096.075944] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54331bd8-45ec-4f27-a691-e602cc0be614 with Priority: HIGHEST for action security_group_rules [ 1096.076126] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54331bd8-45ec-4f27-a691-e602cc0be614 with Priority: HIGHEST for action security_group_members [ 1096.076179] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c8434e7-f0c0-4289-8c3c-b211730f79ef with Priority: HIGHEST for action port [ 1096.077167] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54331bd8-45ec-4f27-a691-e602cc0be614 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.077301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.077376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.077581] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.077661] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54331bd8-45ec-4f27-a691-e602cc0be614',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.078449] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-54331bd8-45ec-4f27-a691-e602cc0be614 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.078565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.078631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.078791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.078933] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.079058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.079095] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.079231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.079314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.079401] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54331bd8-45ec-4f27-a691-e602cc0be614',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.080111] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c8434e7-f0c0-4289-8c3c-b211730f79ef taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.080215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c8434e7-f0c0-4289-8c3c-b211730f79ef" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.080286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c8434e7-f0c0-4289-8c3c-b211730f79ef" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.080466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c8434e7-f0c0-4289-8c3c-b211730f79ef" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.080528] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c8434e7-f0c0-4289-8c3c-b211730f79ef',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.581978] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-54331bd8-45ec-4f27-a691-e602cc0be614 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.582134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.583507] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c8434e7-f0c0-4289-8c3c-b211730f79ef with status ACTIVE [ 1096.583617] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.583716] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.583766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.583997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.584097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.584270] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.584367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.584428] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.584627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.584700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.584825] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.584948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.585009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.585125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.585200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.585284] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c8434e7-f0c0-4289-8c3c-b211730f79ef is going to be updated. [ 1096.586509] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54331bd8-45ec-4f27-a691-e602cc0be614',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.606287] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.606700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.606700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.606700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.606808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.606931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c8434e7-f0c0-4289-8c3c-b211730f79ef" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.704240] env[69499]: INFO networking_nsxv3.common.synchronization [req-51982cd9-e81d-4890-8b30-ede0d7d1a264 req-c2b0fd81-d40d-4eee-9c01-db86a575e436 tempest-ServersTestJSON-756379483 tempest-ServersTestJSON-756379483-project-member] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1096.704919] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1096.705365] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.705554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.705677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.705975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.706234] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.706404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.706524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.706784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.706938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.707108] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.993567] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.993767] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.993896] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.994349] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.994642] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.994813] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.994940] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.995177] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.995631] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.995898] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.996017] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.996139] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.996261] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.996407] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.996523] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.996695] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1097.014080] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1097.014253] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1097.014409] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1097.014592] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.014918] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-43fe3792-67eb-4ec5-9ae3-ab69ae6d8177 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.015155] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-43fe3792-67eb-4ec5-9ae3-ab69ae6d8177" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.015259] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-43fe3792-67eb-4ec5-9ae3-ab69ae6d8177" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.015585] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-43fe3792-67eb-4ec5-9ae3-ab69ae6d8177" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.015724] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43fe3792-67eb-4ec5-9ae3-ab69ae6d8177',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.088398] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54331bd8-45ec-4f27-a691-e602cc0be614',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.209417] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.518416] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.518800] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.519069] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.519558] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.519828] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.520115] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 43fe3792-67eb-4ec5-9ae3-ab69ae6d8177 not found, creating... [ 1097.521347] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.521347] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.521347] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.521549] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.521718] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.522213] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.522491] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.522716] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.524953] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.524953] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.524953] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 43fe3792-67eb-4ec5-9ae3-ab69ae6d8177 is going to be created. [ 1097.542380] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.542597] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.542725] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.543009] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.543253] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.543474] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-43fe3792-67eb-4ec5-9ae3-ab69ae6d8177" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.592717] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.592717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.592717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.592717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.592717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.592717] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54331bd8-45ec-4f27-a691-e602cc0be614 is going to be created. [ 1097.623515] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.623808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.623808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.623992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.624259] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.633661] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54331bd8-45ec-4f27-a691-e602cc0be614 in Status: UNINITIALIZED for 2s [ 1097.712030] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.214939] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.215278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.215278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.215390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.215477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.215570] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1098.245460] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.245679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.245816] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.246152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.246400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.258585] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1098.263790] env[69499]: INFO networking_nsxv3.common.synchronization [req-51982cd9-e81d-4890-8b30-ede0d7d1a264 req-e9c33c6c-8598-4945-ad83-dbeff0544f71 service nova] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_rules [ 1098.263899] env[69499]: INFO networking_nsxv3.common.synchronization [req-51982cd9-e81d-4890-8b30-ede0d7d1a264 req-e9c33c6c-8598-4945-ad83-dbeff0544f71 service nova] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1098.263999] env[69499]: INFO networking_nsxv3.common.synchronization [req-51982cd9-e81d-4890-8b30-ede0d7d1a264 req-e9c33c6c-8598-4945-ad83-dbeff0544f71 service nova] Enqueued Resource ID: 43fe3792-67eb-4ec5-9ae3-ab69ae6d8177 with Priority: HIGHEST for action port [ 1098.264206] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_rules [ 1098.264333] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1098.264442] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43fe3792-67eb-4ec5-9ae3-ab69ae6d8177 with Priority: HIGHEST for action port [ 1098.265022] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.265182] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.265254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.265522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.265606] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.266887] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.267102] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.267584] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-43fe3792-67eb-4ec5-9ae3-ab69ae6d8177 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.267730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43fe3792-67eb-4ec5-9ae3-ab69ae6d8177" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.267782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43fe3792-67eb-4ec5-9ae3-ab69ae6d8177" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.267961] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43fe3792-67eb-4ec5-9ae3-ab69ae6d8177" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.268049] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43fe3792-67eb-4ec5-9ae3-ab69ae6d8177',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.768163] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.768263] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.772718] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43fe3792-67eb-4ec5-9ae3-ab69ae6d8177 with status ACTIVE [ 1098.772960] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.773224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.773224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.773383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.773476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.773725] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.773829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.773896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.774073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.774157] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.774339] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.774442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.774526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.774671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.774747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.774833] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43fe3792-67eb-4ec5-9ae3-ab69ae6d8177 is going to be updated. [ 1098.793666] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.793856] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.793936] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.794183] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.794320] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.794475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43fe3792-67eb-4ec5-9ae3-ab69ae6d8177" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.039882] env[69499]: INFO networking_nsxv3.common.synchronization [req-976449bc-31b9-4645-a021-b91526a7961e req-54676511-00b3-4b64-a7e8-dd0d45a11ef3 tempest-ServersNegativeTestMultiTenantJSON-1807211008 tempest-ServersNegativeTestMultiTenantJSON-1807211008-project-member] Enqueued Resource ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 with Priority: HIGHEST for action security_group_members [ 1099.040536] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 with Priority: HIGHEST for action security_group_members [ 1099.040843] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.040968] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.041392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.041707] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.041871] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.041978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.042056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.042217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.042302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.042399] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b620e3-40b3-45d3-a3ab-72d49b0bf520',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.407876] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-374 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.408304] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-374" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.408507] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-374" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.408975] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-374" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.409410] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.409694] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.409926] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.410276] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.410701] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.411049] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1099.411276] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1099.411517] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1099.411710] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1099.411884] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1099.412161] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1099.412400] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.430933] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.431343] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1099.431670] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.431946] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-374" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.432351] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-76934745-e79a-4fd5-9cba-01ab44b4c121 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.432601] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-76934745-e79a-4fd5-9cba-01ab44b4c121" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.432796] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-76934745-e79a-4fd5-9cba-01ab44b4c121" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.433220] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-76934745-e79a-4fd5-9cba-01ab44b4c121" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.433365] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76934745-e79a-4fd5-9cba-01ab44b4c121',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.545675] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.545675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.545675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.545675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.545972] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.546217] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.546344] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.546412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.546971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.546971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.546971] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 already deleted. [ 1099.546971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.642553] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54331bd8-45ec-4f27-a691-e602cc0be614 in Status: SUCCESS [ 1099.642839] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.643021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.643236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.643428] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.643548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.643613] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.643770] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.643854] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.643937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.644038] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54331bd8-45ec-4f27-a691-e602cc0be614',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.937958] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.942022] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.942022] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.942022] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.942022] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.942022] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 76934745-e79a-4fd5-9cba-01ab44b4c121 not found, creating... [ 1099.942022] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.942022] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.942022] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.942022] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.942022] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.942845] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.942845] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.942845] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.942845] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.942845] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.942845] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 76934745-e79a-4fd5-9cba-01ab44b4c121 is going to be created. [ 1099.959639] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.959871] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.960078] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.960639] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.960888] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.961147] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-76934745-e79a-4fd5-9cba-01ab44b4c121" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.149409] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54331bd8-45ec-4f27-a691-e602cc0be614',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.271402] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1100.271726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.271911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.272201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.272404] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.272534] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.272642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.272833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.272939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.273051] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.648678] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54331bd8-45ec-4f27-a691-e602cc0be614: rpc.has_security_group_logging(os_id): False [ 1100.671200] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.671200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.671200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.671200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.671200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.671200] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.671200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.671200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.671200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.671200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.671200] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54331bd8-45ec-4f27-a691-e602cc0be614 is going to be created. [ 1100.738344] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.738648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.738745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.738962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.739165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.747490] env[69499]: INFO networking_nsxv3.common.synchronization [req-976449bc-31b9-4645-a021-b91526a7961e req-0e333934-5b0b-458b-ba0f-749f4eda27d8 service nova] Enqueued Resource ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 with Priority: HIGHEST for action security_group_rules [ 1100.747685] env[69499]: INFO networking_nsxv3.common.synchronization [req-976449bc-31b9-4645-a021-b91526a7961e req-0e333934-5b0b-458b-ba0f-749f4eda27d8 service nova] Enqueued Resource ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 with Priority: HIGHEST for action security_group_members [ 1100.747821] env[69499]: INFO networking_nsxv3.common.synchronization [req-976449bc-31b9-4645-a021-b91526a7961e req-0e333934-5b0b-458b-ba0f-749f4eda27d8 service nova] Enqueued Resource ID: 76934745-e79a-4fd5-9cba-01ab44b4c121 with Priority: HIGHEST for action port [ 1100.748327] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 with Priority: HIGHEST for action security_group_rules [ 1100.748489] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 with Priority: HIGHEST for action security_group_members [ 1100.748549] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76934745-e79a-4fd5-9cba-01ab44b4c121 with Priority: HIGHEST for action port [ 1100.749219] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b620e3-40b3-45d3-a3ab-72d49b0bf520 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.749394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.749489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.749780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.749899] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b620e3-40b3-45d3-a3ab-72d49b0bf520',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.750916] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.751122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.751195] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.751582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.751808] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.752079] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.752079] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.752220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.752334] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.752566] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b620e3-40b3-45d3-a3ab-72d49b0bf520',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.756295] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-76934745-e79a-4fd5-9cba-01ab44b4c121 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.756478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76934745-e79a-4fd5-9cba-01ab44b4c121" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.756578] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76934745-e79a-4fd5-9cba-01ab44b4c121" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.756869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76934745-e79a-4fd5-9cba-01ab44b4c121" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.756869] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76934745-e79a-4fd5-9cba-01ab44b4c121',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.758650] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54331bd8-45ec-4f27-a691-e602cc0be614 in Status: IN_PROGRESS for 2s [ 1100.775359] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.258522] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0b620e3-40b3-45d3-a3ab-72d49b0bf520',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.261353] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.261517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.261696] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76934745-e79a-4fd5-9cba-01ab44b4c121 with status ACTIVE [ 1101.261865] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.261972] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.262051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.262257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.262343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.262512] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.262609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.262671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.262830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.262906] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.264221] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.264338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.264423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.264587] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.264670] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.264758] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76934745-e79a-4fd5-9cba-01ab44b4c121 is going to be updated. [ 1101.277538] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.284144] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.284144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.284144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.284354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.284428] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.284595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76934745-e79a-4fd5-9cba-01ab44b4c121" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.657330] env[69499]: INFO networking_nsxv3.common.synchronization [None req-f0d04d18-5a56-4361-9c7f-ca8a4f940319 tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 with Priority: HIGHEST for action security_group_rules [ 1101.658022] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 with Priority: HIGHEST for action security_group_rules [ 1101.658407] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.658590] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.658692] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.659294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.659420] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d458bfd-aa6f-4b52-9c71-7e427269cf82',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.737883] env[69499]: INFO networking_nsxv3.common.synchronization [None req-70b4d371-69dc-45c7-9a20-bf278e577bde tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 with Priority: HIGHEST for action security_group_rules [ 1101.738621] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 with Priority: HIGHEST for action security_group_rules [ 1101.739071] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.739193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.767484] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0b620e3-40b3-45d3-a3ab-72d49b0bf520',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.784890] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.784890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.784890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.784890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.784890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.784890] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1101.811938] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.811938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.811938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.811938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.811938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.818225] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1102.188743] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.188912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.189083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.189266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.189361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.189463] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 already deleted. [ 1102.189570] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.189772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.189966] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.190080] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d458bfd-aa6f-4b52-9c71-7e427269cf82',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.269822] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.269822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.269822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.270113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.270113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.270113] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 is going to be created. [ 1102.292372] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.292560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.292602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.294530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.294530] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.302553] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 in Status: UNINITIALIZED for 2s [ 1102.710799] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.711067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.711067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.711247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.711333] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.711434] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 already deleted. [ 1102.711526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.771177] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54331bd8-45ec-4f27-a691-e602cc0be614 in Status: SUCCESS [ 1102.771483] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.828036] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1103.828036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.828036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.828036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.828444] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.828444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.828444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.828622] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.828708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.828796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.828888] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.312229] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 in Status: SUCCESS [ 1104.312453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.312647] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.312876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.313111] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.313236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.313296] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.313539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.313653] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.313746] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.313855] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0b620e3-40b3-45d3-a3ab-72d49b0bf520',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.332046] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.332046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.332046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.332046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.332356] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.332356] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.332429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.332598] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.332666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.332784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.332901] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.332993] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.333064] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.333211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.333347] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.333438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.333495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.333630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.333704] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.333787] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.333878] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.817570] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.817959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.818116] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.818417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.818662] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.818840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.818950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.819171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.819315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.819447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.819660] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.819815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.819914] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.820121] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.820321] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.820522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.820647] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.820841] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.820970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.821111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.821246] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0b620e3-40b3-45d3-a3ab-72d49b0bf520',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.836032] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf01aae2-c409-4ed9-940b-99698ec3968f: rpc.has_security_group_logging(os_id): False [ 1104.855561] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.856051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.856051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.856195] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.856265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.856470] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.856584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.856655] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.856807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.856884] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.857188] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.857188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.857334] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.857380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.857435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.857632] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.857727] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.857787] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.857927] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.858979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.859305] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1104.921486] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.921486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.921486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.921761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.921761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.936469] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1105.323788] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0b620e3-40b3-45d3-a3ab-72d49b0bf520: rpc.has_security_group_logging(os_id): False [ 1105.339804] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.339942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.339985] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.340208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.340300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.340509] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.340642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.340766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.340863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.340965] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.341169] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.341262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.341322] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.341460] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.341531] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.341723] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.341815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.341873] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.342017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.342088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.342171] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 is going to be created. [ 1105.399060] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.399230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.399304] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.399513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.399719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.409828] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 in Status: IN_PROGRESS for 2s [ 1106.739766] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1106.740137] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1106.951430] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1106.951684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.423399] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 in Status: SUCCESS [ 1107.423399] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.525469] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-490 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.525675] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.525820] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.526087] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.526345] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.526548] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.526620] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.526837] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.526984] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.527212] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.527327] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.527450] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.527563] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.527677] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.527784] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.527922] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.547053] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.547053] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1107.547053] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.547053] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-490" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.547304] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-7f6c6bbb-6309-427c-b851-62d5827c319f taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.547304] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.547418] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.547609] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.547752] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f6c6bbb-6309-427c-b851-62d5827c319f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.049477] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.049973] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.049973] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.050173] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.050400] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.050658] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.050851] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.050964] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.051217] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.051363] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.051662] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.051863] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.051988] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.052221] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.052363] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.052511] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 7f6c6bbb-6309-427c-b851-62d5827c319f is going to be updated. [ 1108.078044] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.078517] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.078517] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.078725] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.079090] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.079157] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.476365] env[69499]: INFO networking_nsxv3.common.synchronization [req-9426dd39-a0b8-4e45-91a5-f4ef30f385c3 req-e01657af-5820-4857-9919-72be896d3832 tempest-ServersTestJSON-756379483 tempest-ServersTestJSON-756379483-project-member] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1108.476848] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1108.478030] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.478030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.478030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.478030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.478030] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.478030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.478030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.478030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.478382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.478382] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.792577] env[69499]: INFO networking_nsxv3.common.synchronization [req-a7f72c02-61e6-473f-b2e5-869ecdd2689c req-6a828e92-71b7-4e65-bf08-a50e738a0f3e service nova] Enqueued Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_rules [ 1108.792951] env[69499]: INFO networking_nsxv3.common.synchronization [req-a7f72c02-61e6-473f-b2e5-869ecdd2689c req-6a828e92-71b7-4e65-bf08-a50e738a0f3e service nova] Enqueued Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_members [ 1108.792951] env[69499]: INFO networking_nsxv3.common.synchronization [req-a7f72c02-61e6-473f-b2e5-869ecdd2689c req-6a828e92-71b7-4e65-bf08-a50e738a0f3e service nova] Enqueued Resource ID: 7f6c6bbb-6309-427c-b851-62d5827c319f with Priority: HIGHEST for action port [ 1108.793115] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_rules [ 1108.793249] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_members [ 1108.793341] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6c6bbb-6309-427c-b851-62d5827c319f with Priority: HIGHEST for action port [ 1108.793896] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-547a2dde-952d-4847-b831-1393133e5c28 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.794039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.794104] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.794309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.794401] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.795213] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-547a2dde-952d-4847-b831-1393133e5c28 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.795286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.795327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.797041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.797041] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.797041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.797041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.797041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.797041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.797041] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.797041] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f6c6bbb-6309-427c-b851-62d5827c319f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.797041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.797041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.797848] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.797848] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f6c6bbb-6309-427c-b851-62d5827c319f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.982895] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.298757] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.299826] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-547a2dde-952d-4847-b831-1393133e5c28 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.299939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.300116] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f6c6bbb-6309-427c-b851-62d5827c319f with status ACTIVE [ 1109.300311] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.300442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.300442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.300761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.300761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.300936] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.301052] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.301105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.301264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.301356] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.302080] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.302080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.302080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.302080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.302080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.302080] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f6c6bbb-6309-427c-b851-62d5827c319f is going to be updated. [ 1109.321480] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.321649] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.321723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.321915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.322054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.322203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f6c6bbb-6309-427c-b851-62d5827c319f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.487353] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.804341] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.990302] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.990469] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.990545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.990947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.990947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.991121] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1110.019217] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.019389] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.019493] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.019965] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.019965] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.027531] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1110.307635] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.308058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.308058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.308301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.308439] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.308655] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 547a2dde-952d-4847-b831-1393133e5c28 is going to be updated. [ 1110.338319] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.338319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.338319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.338319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.338319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.345569] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 547a2dde-952d-4847-b831-1393133e5c28 in Status: IN_PROGRESS for 2s [ 1110.367749] env[69499]: INFO networking_nsxv3.common.synchronization [req-7a9828ab-fcc9-49d4-941d-a8640dd36609 req-ddf89dd1-9ae2-4e65-9768-1cfd79ff43af tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 with Priority: HIGHEST for action security_group_members [ 1110.368350] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 with Priority: HIGHEST for action security_group_members [ 1110.368670] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d458bfd-aa6f-4b52-9c71-7e427269cf82 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.368796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.368877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.369149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.369325] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.369430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.369511] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.369666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.369763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.369896] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d458bfd-aa6f-4b52-9c71-7e427269cf82',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.727021] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.727021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.727021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.727021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.727265] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.727325] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.727414] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.727785] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.727785] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.727972] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.728099] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.728211] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.728321] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.729031] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.729031] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.729031] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.750762] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.751218] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1110.751379] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.751565] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.751892] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-b107ee1f-6787-407d-9f8a-57394dc61ae2 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.752085] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-b107ee1f-6787-407d-9f8a-57394dc61ae2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.752214] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-b107ee1f-6787-407d-9f8a-57394dc61ae2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.752549] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-b107ee1f-6787-407d-9f8a-57394dc61ae2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.752695] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b107ee1f-6787-407d-9f8a-57394dc61ae2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.872305] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.872472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.872548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.872772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.872873] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.873145] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.873225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.873263] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.873402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.873491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.873577] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 already deleted. [ 1110.873667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.254715] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.254951] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.255104] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.255404] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.255561] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.255723] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port b107ee1f-6787-407d-9f8a-57394dc61ae2 not found, creating... [ 1111.255987] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.256162] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.256284] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.256506] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.256646] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.256929] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.257100] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.257226] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.257440] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.257577] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.257722] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: b107ee1f-6787-407d-9f8a-57394dc61ae2 is going to be created. [ 1111.279629] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.279864] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.280009] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.280406] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.280776] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.281083] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-b107ee1f-6787-407d-9f8a-57394dc61ae2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.412325] env[69499]: INFO networking_nsxv3.common.synchronization [req-5e352d75-d03b-47ea-83a7-5078a86e08b4 req-e630698e-c606-4ff8-b744-22b586777d31 tempest-ServersNegativeTestMultiTenantJSON-1807211008 tempest-ServersNegativeTestMultiTenantJSON-1807211008-project-member] Enqueued Resource ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 with Priority: HIGHEST for action security_group_members [ 1111.412961] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 with Priority: HIGHEST for action security_group_members [ 1111.413438] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.413572] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.413650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.414805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.414805] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.414805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.414805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.414805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.414805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.414805] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b620e3-40b3-45d3-a3ab-72d49b0bf520',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.916784] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.916970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.917039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.917335] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.917472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.917710] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.917830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.917898] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.918150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.918279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.918394] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 is going to be updated. [ 1111.946743] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.946996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.947086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.947304] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.947447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.955272] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 in Status: IN_PROGRESS for 2s [ 1111.957154] env[69499]: INFO networking_nsxv3.common.synchronization [req-7a9828ab-fcc9-49d4-941d-a8640dd36609 req-9833be17-957d-4273-af04-de2e46fbde78 service nova] Enqueued Resource ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 with Priority: HIGHEST for action security_group_rules [ 1111.957328] env[69499]: INFO networking_nsxv3.common.synchronization [req-7a9828ab-fcc9-49d4-941d-a8640dd36609 req-9833be17-957d-4273-af04-de2e46fbde78 service nova] Enqueued Resource ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 with Priority: HIGHEST for action security_group_members [ 1111.957491] env[69499]: INFO networking_nsxv3.common.synchronization [req-7a9828ab-fcc9-49d4-941d-a8640dd36609 req-9833be17-957d-4273-af04-de2e46fbde78 service nova] Enqueued Resource ID: b107ee1f-6787-407d-9f8a-57394dc61ae2 with Priority: HIGHEST for action port [ 1111.957846] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 with Priority: HIGHEST for action security_group_rules [ 1111.957846] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 with Priority: HIGHEST for action security_group_members [ 1111.957953] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b107ee1f-6787-407d-9f8a-57394dc61ae2 with Priority: HIGHEST for action port [ 1111.958401] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.958523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.958616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.958776] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.958977] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d458bfd-aa6f-4b52-9c71-7e427269cf82',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.959773] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d458bfd-aa6f-4b52-9c71-7e427269cf82 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.959887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.959955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.960136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.960276] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.960371] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.960434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.960571] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.960733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.960801] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d458bfd-aa6f-4b52-9c71-7e427269cf82',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.961508] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-b107ee1f-6787-407d-9f8a-57394dc61ae2 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.961658] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b107ee1f-6787-407d-9f8a-57394dc61ae2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.961824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b107ee1f-6787-407d-9f8a-57394dc61ae2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.961866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b107ee1f-6787-407d-9f8a-57394dc61ae2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.961907] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b107ee1f-6787-407d-9f8a-57394dc61ae2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.041187] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1112.041499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.355898] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 547a2dde-952d-4847-b831-1393133e5c28 in Status: SUCCESS [ 1112.356237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.356375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.356545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.356740] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.356866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.356921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.357095] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.357201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.357293] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.357404] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.464032] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d458bfd-aa6f-4b52-9c71-7e427269cf82 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.464392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.464392] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d458bfd-aa6f-4b52-9c71-7e427269cf82',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.465235] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b107ee1f-6787-407d-9f8a-57394dc61ae2 with status ACTIVE [ 1112.465485] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.465485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.465485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.465894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.465894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.466116] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.466205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.466458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.466458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.466555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.466946] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.466946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.466946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.467117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.467199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.467246] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b107ee1f-6787-407d-9f8a-57394dc61ae2 is going to be updated. [ 1112.495917] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.496198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.496198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.496370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.496465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.496621] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b107ee1f-6787-407d-9f8a-57394dc61ae2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.859469] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.969762] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d458bfd-aa6f-4b52-9c71-7e427269cf82',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.369773] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 547a2dde-952d-4847-b831-1393133e5c28: rpc.has_security_group_logging(os_id): False [ 1113.388344] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.388344] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.388344] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.388344] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.407313] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.407749] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.407923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.408051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.408352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.408493] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.408728] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 547a2dde-952d-4847-b831-1393133e5c28 is going to be updated. [ 1113.465913] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.466251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.466290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.466567] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.466739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.472252] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.472460] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.472546] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.472837] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.473231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.473231] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 is going to be created. [ 1113.485600] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 547a2dde-952d-4847-b831-1393133e5c28 in Status: IN_PROGRESS for 2s [ 1113.495926] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.496138] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.496290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.497234] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.497475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.508970] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 in Status: UNINITIALIZED for 2s [ 1113.967193] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 in Status: SUCCESS [ 1113.967193] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 deletion is rescheduled due to dependency. [ 1113.967193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.959141] env[69499]: INFO networking_nsxv3.common.synchronization [req-054c9d2a-296e-4e12-baf1-d6b9eba2d315 req-66931a93-2637-49a4-91ad-44c37f87703d tempest-ServersTestBootFromVolume-649135408 tempest-ServersTestBootFromVolume-649135408-project-member] Enqueued Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGHEST for action security_group_members [ 1114.959908] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGHEST for action security_group_members [ 1114.960251] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd1b70ed-24ca-4742-b6ba-0af6127fef74 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.960383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.960451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.960690] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.961675] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.961675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.961675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.961675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.961675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.961675] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd1b70ed-24ca-4742-b6ba-0af6127fef74',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.463924] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.464149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.464204] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.464430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.464548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.464751] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.464855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.464918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.465113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.465189] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.465275] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 is going to be updated. [ 1115.500348] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.500532] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.500576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.500915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.501077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.502839] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 547a2dde-952d-4847-b831-1393133e5c28 in Status: SUCCESS [ 1115.503097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.512515] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 in Status: IN_PROGRESS for 2s [ 1115.515941] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 in Status: SUCCESS [ 1115.516200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.516364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.516580] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.516789] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.516910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.516990] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.517163] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.517245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.517332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.517421] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d458bfd-aa6f-4b52-9c71-7e427269cf82',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.020295] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d458bfd-aa6f-4b52-9c71-7e427269cf82',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.522880] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d458bfd-aa6f-4b52-9c71-7e427269cf82: rpc.has_security_group_logging(os_id): False [ 1116.540298] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.540488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.540532] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.540777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.540894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.541161] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.541270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.541371] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.541610] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.541743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.541880] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 is going to be created. [ 1116.607680] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.607895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.607895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.608176] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.608372] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.619399] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 in Status: IN_PROGRESS for 2s [ 1116.851720] env[69499]: INFO networking_nsxv3.common.synchronization [req-2a2fcf4a-652e-4f0e-a00a-7ae199b790e0 req-3825c99d-2e3e-4b5e-a6ac-8410b2c1b6d8 tempest-ServersTestJSON-756379483 tempest-ServersTestJSON-756379483-project-member] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1116.852378] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1116.852866] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.853190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.853190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.853324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.853486] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.853594] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.853660] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.853818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.853905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.855067] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.357079] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.524040] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 in Status: SUCCESS [ 1117.524040] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 deletion is rescheduled due to dependency. [ 1117.524040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.860705] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.364986] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.367830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.367830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.367830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.367830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.367830] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1118.396080] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.396080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.396080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.396080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.396080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.404524] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1118.635189] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 in Status: SUCCESS [ 1118.635189] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.414989] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1120.415314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.853137] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1121.853137] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1124.613072] env[69499]: INFO networking_nsxv3.common.synchronization [None req-ef12d5c3-8a54-4a1e-a66f-943833940cb8 None None] Enqueued Resource ID: 0b01b38e-b73a-487b-a6e8-af1fc958e70b with Priority: HIGHEST for action port [ 1124.613457] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b01b38e-b73a-487b-a6e8-af1fc958e70b with Priority: HIGHEST for action port [ 1124.613925] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b01b38e-b73a-487b-a6e8-af1fc958e70b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.614065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b01b38e-b73a-487b-a6e8-af1fc958e70b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.614135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b01b38e-b73a-487b-a6e8-af1fc958e70b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.615714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b01b38e-b73a-487b-a6e8-af1fc958e70b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.615809] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b01b38e-b73a-487b-a6e8-af1fc958e70b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.118456] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b01b38e-b73a-487b-a6e8-af1fc958e70b [ 1125.118639] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.118639] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.118767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.119332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.119332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.119332] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b01b38e-b73a-487b-a6e8-af1fc958e70b already deleted. [ 1125.119332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b01b38e-b73a-487b-a6e8-af1fc958e70b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.672434] env[69499]: INFO networking_nsxv3.common.synchronization [None req-e80adaca-9aaa-439b-bdad-c2515ffd3dca None None] Enqueued Resource ID: e0150680-53b9-4f3c-8a9e-209405328b10 with Priority: HIGHEST for action port [ 1126.672719] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0150680-53b9-4f3c-8a9e-209405328b10 with Priority: HIGHEST for action port [ 1126.673369] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0150680-53b9-4f3c-8a9e-209405328b10 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.673457] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0150680-53b9-4f3c-8a9e-209405328b10" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.673509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0150680-53b9-4f3c-8a9e-209405328b10" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.673765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0150680-53b9-4f3c-8a9e-209405328b10" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.673852] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0150680-53b9-4f3c-8a9e-209405328b10',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.118882] env[69499]: INFO networking_nsxv3.common.synchronization [req-15e6de79-24f5-441a-90c1-98ea07f30dd5 req-3de4901d-1096-4312-ba3e-869a6efd8f12 tempest-ServersTestJSON-756379483 tempest-ServersTestJSON-756379483-project-member] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1127.119461] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1127.119765] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.119891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.119954] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.120171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.120337] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.121228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.121228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.121228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.121228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.121228] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.180233] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0150680-53b9-4f3c-8a9e-209405328b10 [ 1127.180473] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.180673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.180810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.182349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.182349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.182349] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0150680-53b9-4f3c-8a9e-209405328b10 already deleted. [ 1127.182349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0150680-53b9-4f3c-8a9e-209405328b10" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.479772] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.479978] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.480127] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.480414] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.480675] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.480880] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.480984] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.481227] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.481378] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.481597] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.481716] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.481832] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.481944] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.482070] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.482183] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.482320] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.502723] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.502886] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1127.503031] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.503211] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.503502] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-8c75f6b0-5e09-42c3-b65d-84b6ab741698 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.503668] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-8c75f6b0-5e09-42c3-b65d-84b6ab741698" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.503790] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-8c75f6b0-5e09-42c3-b65d-84b6ab741698" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.504190] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-8c75f6b0-5e09-42c3-b65d-84b6ab741698" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.504336] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c75f6b0-5e09-42c3-b65d-84b6ab741698',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.625899] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.006468] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.006742] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.006835] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.007160] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.007320] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.007480] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 8c75f6b0-5e09-42c3-b65d-84b6ab741698 not found, creating... [ 1128.007763] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.007910] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.008041] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.008272] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.008415] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.008693] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.008953] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.009174] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.009499] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.009725] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.009968] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 8c75f6b0-5e09-42c3-b65d-84b6ab741698 is going to be created. [ 1128.028746] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.028964] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.029115] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.029363] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.029593] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.029816] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-8c75f6b0-5e09-42c3-b65d-84b6ab741698" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.127774] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.630716] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.630823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.630964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.631218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.631316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.631505] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1128.660563] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.660783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.660783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.661058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.661213] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.670849] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1128.718712] env[69499]: INFO networking_nsxv3.common.synchronization [req-15e6de79-24f5-441a-90c1-98ea07f30dd5 req-ba8be034-4c2d-4643-908e-dc35fe82f00b service nova] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_rules [ 1128.718928] env[69499]: INFO networking_nsxv3.common.synchronization [req-15e6de79-24f5-441a-90c1-98ea07f30dd5 req-ba8be034-4c2d-4643-908e-dc35fe82f00b service nova] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1128.719133] env[69499]: INFO networking_nsxv3.common.synchronization [req-15e6de79-24f5-441a-90c1-98ea07f30dd5 req-ba8be034-4c2d-4643-908e-dc35fe82f00b service nova] Enqueued Resource ID: 8c75f6b0-5e09-42c3-b65d-84b6ab741698 with Priority: HIGHEST for action port [ 1128.719677] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_rules [ 1128.719875] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1128.719964] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c75f6b0-5e09-42c3-b65d-84b6ab741698 with Priority: HIGHEST for action port [ 1128.720963] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.721150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.721188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.721443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.721539] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.723408] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.723561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.724122] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c75f6b0-5e09-42c3-b65d-84b6ab741698 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.724275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c75f6b0-5e09-42c3-b65d-84b6ab741698" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.724359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c75f6b0-5e09-42c3-b65d-84b6ab741698" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.724711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c75f6b0-5e09-42c3-b65d-84b6ab741698" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.724801] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c75f6b0-5e09-42c3-b65d-84b6ab741698',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.227403] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c75f6b0-5e09-42c3-b65d-84b6ab741698 with status ACTIVE [ 1129.227765] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.227845] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.227880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.228238] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.228355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.228560] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.228651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.228738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.228896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.228979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.229186] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.229277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.229339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.229485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.229559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.229647] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c75f6b0-5e09-42c3-b65d-84b6ab741698 is going to be updated. [ 1129.230896] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.231023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.255472] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.255726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.255726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.255878] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.256061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.256234] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c75f6b0-5e09-42c3-b65d-84b6ab741698" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.679590] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1130.679889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.680119] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.680551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.680601] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.680740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.680826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.681038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.681170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.681338] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.183900] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.687054] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.189364] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.189364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.189364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.189604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.189718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.189781] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1132.222786] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.222953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.222953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.223168] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.223310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.232377] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1132.575036] env[69499]: INFO networking_nsxv3.common.synchronization [req-d9e19b18-9099-4bce-a5e7-c9b571d07772 req-14bb3d84-f03d-4cb5-bf6b-4f5aebe09e6c tempest-InstanceActionsTestJSON-616347374 tempest-InstanceActionsTestJSON-616347374-project-member] Enqueued Resource ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 with Priority: HIGHEST for action security_group_members [ 1132.575904] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 with Priority: HIGHEST for action security_group_members [ 1132.575904] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dc31b3-f317-4f68-a90f-eaf8e6587e97 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.576021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.576179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.576457] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.576626] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.576731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.576789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.576956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.577049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.577142] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40dc31b3-f317-4f68-a90f-eaf8e6587e97',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.934788] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-317 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.935143] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-317" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.935386] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-317" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.935879] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-317" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.936306] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.936498] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.936762] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.937017] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.937201] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.937397] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.937506] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.937619] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.937728] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.937842] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.937951] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.940719] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.956803] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.956803] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1132.957010] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.957054] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-317" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.957371] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-261c1be9-79e1-42d5-ae93-54b9b4777e7c taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.957559] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-261c1be9-79e1-42d5-ae93-54b9b4777e7c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.957763] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-261c1be9-79e1-42d5-ae93-54b9b4777e7c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.957998] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-261c1be9-79e1-42d5-ae93-54b9b4777e7c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.958223] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('261c1be9-79e1-42d5-ae93-54b9b4777e7c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.079660] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.079971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.080082] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.080325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.080427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.080651] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.080758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.080822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.081058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.081145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.081235] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 already deleted. [ 1133.081318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.461574] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.461818] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.461937] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.462678] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.462860] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.463068] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 261c1be9-79e1-42d5-ae93-54b9b4777e7c not found, creating... [ 1133.463440] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.463622] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.463748] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.463991] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.464156] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.464446] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.464814] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.464814] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.464959] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.465083] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.465230] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 261c1be9-79e1-42d5-ae93-54b9b4777e7c is going to be created. [ 1133.484490] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.484639] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.484759] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.484994] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.485238] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.485454] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-261c1be9-79e1-42d5-ae93-54b9b4777e7c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.204328] env[69499]: INFO networking_nsxv3.common.synchronization [req-d9e19b18-9099-4bce-a5e7-c9b571d07772 req-1892959e-25f4-4438-9aef-f0594c480c5b service nova] Enqueued Resource ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 with Priority: HIGHEST for action security_group_rules [ 1134.204595] env[69499]: INFO networking_nsxv3.common.synchronization [req-d9e19b18-9099-4bce-a5e7-c9b571d07772 req-1892959e-25f4-4438-9aef-f0594c480c5b service nova] Enqueued Resource ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 with Priority: HIGHEST for action security_group_members [ 1134.204700] env[69499]: INFO networking_nsxv3.common.synchronization [req-d9e19b18-9099-4bce-a5e7-c9b571d07772 req-1892959e-25f4-4438-9aef-f0594c480c5b service nova] Enqueued Resource ID: 261c1be9-79e1-42d5-ae93-54b9b4777e7c with Priority: HIGHEST for action port [ 1134.204897] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 with Priority: HIGHEST for action security_group_rules [ 1134.205035] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 with Priority: HIGHEST for action security_group_members [ 1134.205139] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261c1be9-79e1-42d5-ae93-54b9b4777e7c with Priority: HIGHEST for action port [ 1134.205670] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40dc31b3-f317-4f68-a90f-eaf8e6587e97 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.205806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.205862] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.206230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.206318] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40dc31b3-f317-4f68-a90f-eaf8e6587e97',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.207159] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dc31b3-f317-4f68-a90f-eaf8e6587e97 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.207277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.207394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.207517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.207662] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.207758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.207818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.207982] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.208047] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.208138] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40dc31b3-f317-4f68-a90f-eaf8e6587e97',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.208870] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-261c1be9-79e1-42d5-ae93-54b9b4777e7c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.209101] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-261c1be9-79e1-42d5-ae93-54b9b4777e7c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.209101] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-261c1be9-79e1-42d5-ae93-54b9b4777e7c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.209244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-261c1be9-79e1-42d5-ae93-54b9b4777e7c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.209377] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('261c1be9-79e1-42d5-ae93-54b9b4777e7c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.244250] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1134.244446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.244825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.245033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.245213] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.245319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.245380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.245531] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.245610] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.245695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.245782] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.711309] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dc31b3-f317-4f68-a90f-eaf8e6587e97 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.711309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.713068] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40dc31b3-f317-4f68-a90f-eaf8e6587e97',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.713487] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 261c1be9-79e1-42d5-ae93-54b9b4777e7c with status ACTIVE [ 1134.713676] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.713792] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.713860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.714218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.714218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.714358] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.714458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.714517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.714674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.714752] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.714930] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.715034] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.715092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.715231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.715301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.715524] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 261c1be9-79e1-42d5-ae93-54b9b4777e7c is going to be updated. [ 1134.734944] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.735144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.735263] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.735525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.735728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.735953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-261c1be9-79e1-42d5-ae93-54b9b4777e7c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.748318] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.748451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.748500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.748665] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.748814] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.749024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.749024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.749152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.749236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.749319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.749461] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.749550] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.749608] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.749745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.749879] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.749970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.750043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.750177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.750251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.750328] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.750558] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.218022] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40dc31b3-f317-4f68-a90f-eaf8e6587e97',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.252138] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf01aae2-c409-4ed9-940b-99698ec3968f: rpc.has_security_group_logging(os_id): False [ 1135.270526] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.270682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.270743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.271080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.271116] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.271322] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.271428] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.271500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.271640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.271721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.271902] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.272021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.272068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.272237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.272314] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.272711] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.272711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.272711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.272864] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.272864] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.272950] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1135.327764] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.327943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.327943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.328173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.328322] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.339259] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1135.720913] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.721252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.721348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.721612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.721714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.721819] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 is going to be created. [ 1135.744168] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.744331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.744376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.744582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.744737] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.754108] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 in Status: UNINITIALIZED for 2s [ 1137.351879] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1137.352234] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.763145] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 in Status: SUCCESS [ 1137.763479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.763701] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.763982] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.764272] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.764435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.764536] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.764745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.764869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.764987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.765154] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40dc31b3-f317-4f68-a90f-eaf8e6587e97',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.267377] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dc31b3-f317-4f68-a90f-eaf8e6587e97 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.267609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.267609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.267806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.267975] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.268097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.268161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.268317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.268408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.268499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.268645] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dc31b3-f317-4f68-a90f-eaf8e6587e97 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.268740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.268802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.269034] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.269181] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.269277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.269340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.269486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.269562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.269643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.269728] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40dc31b3-f317-4f68-a90f-eaf8e6587e97',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.771486] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40dc31b3-f317-4f68-a90f-eaf8e6587e97: rpc.has_security_group_logging(os_id): False [ 1138.788599] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.788757] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.788833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.789180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.789280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.789501] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.789603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.789664] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.789820] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.789894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.790095] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.790363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.790363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.790443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.790443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.790621] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.790711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.790774] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.790912] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.790984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.791149] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 is going to be created. [ 1138.851294] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.851482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.851576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.851843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.852190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.864013] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 in Status: IN_PROGRESS for 2s [ 1139.206145] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1139.206326] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1139.298216] env[69499]: INFO networking_nsxv3.common.synchronization [req-26b700e4-9409-4011-b4e9-00fe30f8da58 req-de89ff59-e6bd-4285-b4ce-f8a02b8a6f1c tempest-ServersTestJSON-756379483 tempest-ServersTestJSON-756379483-project-member] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1139.298805] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1139.299117] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.299242] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.299309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.299509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.299659] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.299753] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.299815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.299967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.300160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.300160] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.801895] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.304286] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.806672] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.806672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.807112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.807112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.807233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.807291] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1140.837640] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.837640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.837640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.837640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.837640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.847907] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1140.875983] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 in Status: SUCCESS [ 1140.875983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.857591] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1142.857836] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.300072] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1144.300072] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1148.340628] env[69499]: INFO networking_nsxv3.common.synchronization [req-b12d2d7a-d4ce-43f6-9fb9-36258f427eeb req-f8c0d7ed-3cd7-4fe6-abf3-2e790a0e682d tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1148.341199] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1148.341559] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.343750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.343750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.343750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.343750] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.343750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.343750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.343750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.343750] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.343750] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.665785] env[69499]: INFO networking_nsxv3.common.synchronization [req-16abf813-3a1c-415a-9e7b-5cf3f0909b25 req-8a270ec3-5eb5-4f24-bf7c-0bc5751bfcc6 tempest-ServersTestJSON-756379483 tempest-ServersTestJSON-756379483-project-member] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1148.666511] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1148.666892] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.667160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.667315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.667577] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.667791] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.667946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.668059] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.668269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.668412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.668542] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.804505] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.807330] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.807477] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.807773] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.808072] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.808254] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.808362] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.808598] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.808743] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.810777] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.810919] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.811056] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.811225] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.811363] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.811485] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.811661] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.833784] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.833972] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1148.834133] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.834309] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.834682] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-4a07a347-4ebd-45aa-9d25-960f7a85e3bc taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.835042] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-4a07a347-4ebd-45aa-9d25-960f7a85e3bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.835042] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-4a07a347-4ebd-45aa-9d25-960f7a85e3bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.835315] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-4a07a347-4ebd-45aa-9d25-960f7a85e3bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.835453] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a07a347-4ebd-45aa-9d25-960f7a85e3bc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.846212] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.846212] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.846333] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.846463] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.847045] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.847045] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.849180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.849256] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.849424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.849506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.849628] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1148.872743] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.872887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.872961] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.873280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.873420] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.881332] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1148.993926] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.994158] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.996563] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.996563] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.996563] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.996563] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.996563] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.996563] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.997231] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.997231] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.997231] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.997358] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.997529] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.997576] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.997723] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.997860] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1149.014624] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1149.014866] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1149.015358] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1149.015551] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-647" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.015918] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.016150] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.016316] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.016692] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.016881] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.079196] env[69499]: INFO networking_nsxv3.common.synchronization [req-46f1c5d0-74a6-466d-a0bb-32f261da369b req-886d27fa-8f0b-4bf5-a16a-57c2f63ed2de tempest-InstanceActionsTestJSON-616347374 tempest-InstanceActionsTestJSON-616347374-project-member] Enqueued Resource ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 with Priority: HIGHEST for action security_group_members [ 1149.079744] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 with Priority: HIGHEST for action security_group_members [ 1149.080630] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dc31b3-f317-4f68-a90f-eaf8e6587e97 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.080630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.080630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.081261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.081261] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.081261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.081261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.082432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.082547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.082663] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40dc31b3-f317-4f68-a90f-eaf8e6587e97',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.171517] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.337332] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.337574] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.337729] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.338062] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.338226] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.338391] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 4a07a347-4ebd-45aa-9d25-960f7a85e3bc not found, creating... [ 1149.338655] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.338816] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.338941] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.339214] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.339359] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.339679] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.339847] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.339971] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.340206] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.340349] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.340493] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 4a07a347-4ebd-45aa-9d25-960f7a85e3bc is going to be created. [ 1149.359717] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.360000] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.360000] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.360228] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.360468] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.360695] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-4a07a347-4ebd-45aa-9d25-960f7a85e3bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.519354] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.519575] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.519942] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.520113] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.520161] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.520286] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc not found, creating... [ 1149.520585] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.520757] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.520877] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.521113] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.521320] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.521611] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.521771] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.521888] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.522120] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.522306] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.522460] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc is going to be created. [ 1149.541540] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.541780] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.541960] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.542271] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.542510] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.542740] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.584766] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.584766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.584766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.584916] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.584977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.585197] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.585301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.585365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.585521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.585600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.585687] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 is going to be updated. [ 1149.633454] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.633677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.633677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.633851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.633991] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.642696] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 in Status: IN_PROGRESS for 2s [ 1149.673226] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.083620] env[69499]: INFO networking_nsxv3.common.synchronization [req-b12d2d7a-d4ce-43f6-9fb9-36258f427eeb req-b4a98cff-f416-4d27-8bd0-8734a79fda66 service nova] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_rules [ 1150.083811] env[69499]: INFO networking_nsxv3.common.synchronization [req-b12d2d7a-d4ce-43f6-9fb9-36258f427eeb req-b4a98cff-f416-4d27-8bd0-8734a79fda66 service nova] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1150.083957] env[69499]: INFO networking_nsxv3.common.synchronization [req-b12d2d7a-d4ce-43f6-9fb9-36258f427eeb req-b4a98cff-f416-4d27-8bd0-8734a79fda66 service nova] Enqueued Resource ID: 4a07a347-4ebd-45aa-9d25-960f7a85e3bc with Priority: HIGHEST for action port [ 1150.084207] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_rules [ 1150.084334] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1150.084429] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a07a347-4ebd-45aa-9d25-960f7a85e3bc with Priority: HIGHEST for action port [ 1150.084982] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.086449] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.086725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.087074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.087285] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.089474] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.089901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.090020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a07a347-4ebd-45aa-9d25-960f7a85e3bc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.090585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a07a347-4ebd-45aa-9d25-960f7a85e3bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.090667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a07a347-4ebd-45aa-9d25-960f7a85e3bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.090981] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a07a347-4ebd-45aa-9d25-960f7a85e3bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.091541] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a07a347-4ebd-45aa-9d25-960f7a85e3bc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.177297] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.177897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.178084] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.178593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.178593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.178593] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1150.226165] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.226320] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.226389] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.226606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.226755] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.235804] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1150.292063] env[69499]: INFO networking_nsxv3.common.synchronization [req-16abf813-3a1c-415a-9e7b-5cf3f0909b25 req-33b86d15-7f03-4912-81c2-2179169a2e8e service nova] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_rules [ 1150.292063] env[69499]: INFO networking_nsxv3.common.synchronization [req-16abf813-3a1c-415a-9e7b-5cf3f0909b25 req-33b86d15-7f03-4912-81c2-2179169a2e8e service nova] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1150.292063] env[69499]: INFO networking_nsxv3.common.synchronization [req-16abf813-3a1c-415a-9e7b-5cf3f0909b25 req-33b86d15-7f03-4912-81c2-2179169a2e8e service nova] Enqueued Resource ID: acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc with Priority: HIGHEST for action port [ 1150.292063] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_rules [ 1150.292063] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1150.292063] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc with Priority: HIGHEST for action port [ 1150.293097] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.293097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.293097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.293278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.293278] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.294956] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.295050] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.295209] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.295318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.295386] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.295561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.295635] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.595372] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a07a347-4ebd-45aa-9d25-960f7a85e3bc with status ACTIVE [ 1150.595809] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.596269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.596269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.596430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.596512] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.596788] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.597017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.597150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.597302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.597433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.597719] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.597874] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.597977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.598211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.598784] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.598784] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a07a347-4ebd-45aa-9d25-960f7a85e3bc is going to be updated. [ 1150.600155] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.600281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.619572] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.619775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.619775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.619971] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.620146] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.620366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a07a347-4ebd-45aa-9d25-960f7a85e3bc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.797175] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.797346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.797667] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc with status ACTIVE [ 1150.797816] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.797922] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.797992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.798226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.798370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.798505] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.798603] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.798657] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.798823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.798910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.799092] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.799213] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.799282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.799432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.799507] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.799592] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc is going to be updated. [ 1150.821935] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.822140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.822140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.822363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.822500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.822650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acf53e6b-2fc4-4a89-b6a7-bd9bd16ec8fc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.891013] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1150.891284] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 deletion is rescheduled due to dependency. [ 1150.891414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.891568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.891783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.891962] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.892091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.892155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.892469] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.892567] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.892672] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.394515] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.652051] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 in Status: SUCCESS [ 1151.652051] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 deletion is rescheduled due to dependency. [ 1151.652051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.897120] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.245741] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1152.246012] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.246215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.246475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.246677] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.246848] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.246930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.247227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.247307] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.247399] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.399412] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.399633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.399711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.399987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.400130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.400248] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1152.430409] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.430572] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.430666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.430956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.431164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.440447] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1152.752020] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.252986] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.757311] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.757311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.757311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.757311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.757311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.757311] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1153.804450] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.804450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.804450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.804450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.804450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.817242] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1154.450292] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1154.450512] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.450678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.450890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.451089] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.451205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.451277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.451461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.451539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.451630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.451711] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.639497] env[69499]: INFO networking_nsxv3.common.synchronization [None req-e23c69f7-1b8c-4071-96a4-d7bf92859c58 tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1154.639497] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1154.639497] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.639497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.639497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.639919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.639919] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.640018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.640018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.641054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.641054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.641054] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.954442] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.954823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.142826] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.644939] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.828873] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1155.829251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.829329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.829510] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.829707] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.829826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.829894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.830268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.830268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.830268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.830369] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.148314] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.148677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.148677] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.148745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.148831] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.148959] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1156.195290] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.195487] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.195487] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.195714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.195873] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.215000] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1156.333198] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.333198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.333198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.333414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.333650] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.333818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.333933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.334132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.334248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.334374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.334535] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.338184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.338184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.338184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.338184] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.338184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.338184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.338184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.338184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.338184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.338184] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.838018] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf01aae2-c409-4ed9-940b-99698ec3968f: rpc.has_security_group_logging(os_id): False [ 1156.855678] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.855825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.855993] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.856113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.856209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.856404] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.856503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.856699] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.856699] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.856786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.856974] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.857088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.857152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.857293] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.857364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.857555] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.857651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.857703] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.857841] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.857982] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.858023] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1156.915945] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.916113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.916206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.916438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.916584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.929074] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1157.001338] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.001554] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.001688] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.001982] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.002309] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.002493] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.002615] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.002846] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.002998] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.003234] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.003354] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.003468] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.003579] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.003740] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.003877] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.004023] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.031958] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.032140] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1157.032302] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.032498] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.032824] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-c9b320a2-bb90-466a-a1a3-d15690648402 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.032993] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-c9b320a2-bb90-466a-a1a3-d15690648402" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.033131] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-c9b320a2-bb90-466a-a1a3-d15690648402" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.033466] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-c9b320a2-bb90-466a-a1a3-d15690648402" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.033616] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9b320a2-bb90-466a-a1a3-d15690648402',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.539020] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.539020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.539020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.539020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.539020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.539020] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port c9b320a2-bb90-466a-a1a3-d15690648402 not found, creating... [ 1157.539020] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.539020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.539020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.539020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.539020] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.539744] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.539744] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.539744] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.539744] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.539744] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.539744] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: c9b320a2-bb90-466a-a1a3-d15690648402 is going to be created. [ 1157.560607] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.560607] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.560607] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.560607] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.560607] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.560607] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-c9b320a2-bb90-466a-a1a3-d15690648402" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.658026] env[69499]: INFO networking_nsxv3.common.synchronization [None req-915a97ea-e00a-4a63-9dc9-add279579de1 None None] Enqueued Resource ID: e36c7137-59f8-4498-bb80-1e459f5076a8 with Priority: HIGHEST for action port [ 1157.658026] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e36c7137-59f8-4498-bb80-1e459f5076a8 with Priority: HIGHEST for action port [ 1157.658026] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e36c7137-59f8-4498-bb80-1e459f5076a8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.658026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e36c7137-59f8-4498-bb80-1e459f5076a8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.658026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e36c7137-59f8-4498-bb80-1e459f5076a8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.658026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e36c7137-59f8-4498-bb80-1e459f5076a8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.658026] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e36c7137-59f8-4498-bb80-1e459f5076a8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.161203] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e36c7137-59f8-4498-bb80-1e459f5076a8 [ 1158.161203] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.161203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.161203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.161203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.161203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.161203] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e36c7137-59f8-4498-bb80-1e459f5076a8 already deleted. [ 1158.161203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e36c7137-59f8-4498-bb80-1e459f5076a8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.227065] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.227065] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.227065] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.227065] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.227065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.227757] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.227757] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.340587] env[69499]: INFO networking_nsxv3.common.synchronization [req-4f0e41f3-9c67-4379-8229-cd797c309326 req-eb3bba9d-a6f5-4fea-a5b7-750948c9af27 service nova] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_rules [ 1158.340767] env[69499]: INFO networking_nsxv3.common.synchronization [req-4f0e41f3-9c67-4379-8229-cd797c309326 req-eb3bba9d-a6f5-4fea-a5b7-750948c9af27 service nova] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1158.340908] env[69499]: INFO networking_nsxv3.common.synchronization [req-4f0e41f3-9c67-4379-8229-cd797c309326 req-eb3bba9d-a6f5-4fea-a5b7-750948c9af27 service nova] Enqueued Resource ID: c9b320a2-bb90-466a-a1a3-d15690648402 with Priority: HIGHEST for action port [ 1158.341157] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_rules [ 1158.341288] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1158.341385] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b320a2-bb90-466a-a1a3-d15690648402 with Priority: HIGHEST for action port [ 1158.341921] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.342524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.343016] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.343279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.343350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.343744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.343881] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.344443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.344517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.344681] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.344767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.344863] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.345679] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9b320a2-bb90-466a-a1a3-d15690648402 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.345789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9b320a2-bb90-466a-a1a3-d15690648402" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.345941] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9b320a2-bb90-466a-a1a3-d15690648402" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.346266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9b320a2-bb90-466a-a1a3-d15690648402" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.346266] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9b320a2-bb90-466a-a1a3-d15690648402',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.730929] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4968c8b1-e03b-4720-ad0c-9445bc9427b6: rpc.has_security_group_logging(os_id): False [ 1158.748142] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.748292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.748371] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.748593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.748685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.748918] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.749029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.749094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.749247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.749339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.749615] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.749662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.749701] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.749822] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.750154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.750154] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.750280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.750280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.750374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.750451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.750553] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1158.836028] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.836028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.836028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.836028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.836028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.846244] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1158.848123] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.849079] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9b320a2-bb90-466a-a1a3-d15690648402 with status ACTIVE [ 1158.849320] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.849470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.850047] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.850047] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.850047] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.850294] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.850294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.850396] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.850544] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.850639] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.850866] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.850978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.851074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.851255] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.851374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.851825] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9b320a2-bb90-466a-a1a3-d15690648402 is going to be updated. [ 1158.883051] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.883051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.883051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.883051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.883051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.883398] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9b320a2-bb90-466a-a1a3-d15690648402" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.941683] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1158.941925] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.354071] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.730715] env[69499]: INFO networking_nsxv3.common.synchronization [None req-9f118676-3ed5-4240-87f2-46c642aef109 None None] Enqueued Resource ID: 5c3d3ab9-0d97-499d-9750-eab45098e24f with Priority: HIGHEST for action port [ 1159.730979] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c3d3ab9-0d97-499d-9750-eab45098e24f with Priority: HIGHEST for action port [ 1159.731564] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c3d3ab9-0d97-499d-9750-eab45098e24f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.731693] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c3d3ab9-0d97-499d-9750-eab45098e24f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.731807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c3d3ab9-0d97-499d-9750-eab45098e24f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.732027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c3d3ab9-0d97-499d-9750-eab45098e24f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.732143] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c3d3ab9-0d97-499d-9750-eab45098e24f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.856812] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.856985] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.857060] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.857272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.857362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.857665] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1159.883085] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.883262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.883306] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.883499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.883648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.892277] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1160.233603] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c3d3ab9-0d97-499d-9750-eab45098e24f [ 1160.233843] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.233978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.234063] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.234289] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.234389] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.234519] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c3d3ab9-0d97-499d-9750-eab45098e24f already deleted. [ 1160.234612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c3d3ab9-0d97-499d-9750-eab45098e24f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.859020] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1160.859392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.859500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.859798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.859951] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.363354] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.363546] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.443980] env[69499]: INFO networking_nsxv3.common.synchronization [req-74cdb50c-a30e-4456-a50c-9e26bdcf637a req-a82bfd69-39e4-4a0d-b02a-422e9748090b tempest-ServerActionsTestJSON-629709431 tempest-ServerActionsTestJSON-629709431-project-member] Enqueued Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 1161.444540] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 1161.444892] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.444959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.445720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.445976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.446184] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.446325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.446415] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.446597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.446717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.446835] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.866728] env[69499]: INFO networking_nsxv3.common.synchronization [req-0c4d6b09-45c5-4be0-aad1-6432eb60d4ce req-fc2b0d5a-6548-432e-9d2e-fbede520c7e9 tempest-AttachVolumeShelveTestJSON-1831532901 tempest-AttachVolumeShelveTestJSON-1831532901-project-member] Enqueued Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_members [ 1161.867278] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGHEST for action security_group_members [ 1161.867646] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-547a2dde-952d-4847-b831-1393133e5c28 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.867808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.867888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.868139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.868322] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.868447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.868520] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.868710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.868817] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.868918] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.902816] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1161.902961] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.903110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.903335] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.903525] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.903643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.903728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.903890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.903973] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.904074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.904164] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.948856] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.949091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.949091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.949303] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.949392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.949587] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.949681] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.949928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.949928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.950088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.950088] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 is going to be updated. [ 1161.974510] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.974649] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.974712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.974921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.975075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.982648] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: IN_PROGRESS for 2s [ 1162.371558] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.371558] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.371558] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.371558] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.371841] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.371841] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.371923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.371958] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.372134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.372216] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.372302] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 547a2dde-952d-4847-b831-1393133e5c28 is going to be updated. [ 1162.398226] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.398406] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.398406] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.398595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.398756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.406597] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 547a2dde-952d-4847-b831-1393133e5c28 in Status: IN_PROGRESS for 2s [ 1162.406871] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.406992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.407071] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.407248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.407404] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.407559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.407559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.407712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.407790] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.407871] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.408022] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.408123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.408169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.408309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.408459] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.408553] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.408610] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.408740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.408816] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.408894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.408981] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.910805] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4968c8b1-e03b-4720-ad0c-9445bc9427b6: rpc.has_security_group_logging(os_id): False [ 1162.928065] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.928207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.928272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.928484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.928584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.928794] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.928894] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.928959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.929119] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.929195] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.929379] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.929498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.929577] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.929735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.929810] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.929993] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.930098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.930158] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.930296] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.930372] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.930461] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1162.993867] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.994032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.994080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.994287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.994430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.008024] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1163.394948] env[69499]: INFO networking_nsxv3.common.synchronization [req-4f3ff9e3-6fcd-4145-a22c-f134a841a6c8 req-75209009-1873-433e-be27-eca5ffc68486 tempest-ServerRescueTestJSON-863883418 tempest-ServerRescueTestJSON-863883418-project-member] Enqueued Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_members [ 1163.395544] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_members [ 1163.395962] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.395962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.396348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.396613] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.396824] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.396917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.396951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.397150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.397244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.397340] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.826508] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-827 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.826683] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-827" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.826831] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-827" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.827171] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-827" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.827428] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.827590] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.827709] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.827924] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.828271] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.828503] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1163.828624] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1163.828736] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1163.828852] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1163.829017] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1163.829149] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1163.829203] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1163.846715] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1163.846887] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1163.847045] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1163.847674] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-827" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.847674] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-fe6574fb-99cc-49bd-b35d-77727ac2ea9c taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.847674] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-fe6574fb-99cc-49bd-b35d-77727ac2ea9c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.847856] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-fe6574fb-99cc-49bd-b35d-77727ac2ea9c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.848114] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-fe6574fb-99cc-49bd-b35d-77727ac2ea9c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.848266] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe6574fb-99cc-49bd-b35d-77727ac2ea9c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.899118] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.899327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.899431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.899641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.899764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.899985] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.900173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.900232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.900716] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.900808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.900899] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 already deleted. [ 1163.900982] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.994262] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: SUCCESS [ 1163.994530] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 deletion is rescheduled due to dependency. [ 1163.994577] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.350850] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.351113] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.351359] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.351580] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.351750] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.351905] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port fe6574fb-99cc-49bd-b35d-77727ac2ea9c not found, creating... [ 1164.352201] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.352364] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.352507] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.352740] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.352887] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.353231] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.353395] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.353518] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.353735] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.353873] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.354025] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: fe6574fb-99cc-49bd-b35d-77727ac2ea9c is going to be created. [ 1164.374024] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.374024] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.374024] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.374247] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.374445] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.374734] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-fe6574fb-99cc-49bd-b35d-77727ac2ea9c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.421241] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 547a2dde-952d-4847-b831-1393133e5c28 in Status: SUCCESS [ 1164.421561] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 547a2dde-952d-4847-b831-1393133e5c28 deletion is rescheduled due to dependency. [ 1164.421721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.021564] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1165.021564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.111645] env[69499]: INFO networking_nsxv3.common.synchronization [req-4f3ff9e3-6fcd-4145-a22c-f134a841a6c8 req-468d3986-be2c-45c2-95c2-dacb72f2bcee service nova] Enqueued Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_rules [ 1165.111645] env[69499]: INFO networking_nsxv3.common.synchronization [req-4f3ff9e3-6fcd-4145-a22c-f134a841a6c8 req-468d3986-be2c-45c2-95c2-dacb72f2bcee service nova] Enqueued Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_members [ 1165.111645] env[69499]: INFO networking_nsxv3.common.synchronization [req-4f3ff9e3-6fcd-4145-a22c-f134a841a6c8 req-468d3986-be2c-45c2-95c2-dacb72f2bcee service nova] Enqueued Resource ID: fe6574fb-99cc-49bd-b35d-77727ac2ea9c with Priority: HIGHEST for action port [ 1165.111645] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_rules [ 1165.111645] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_members [ 1165.111645] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe6574fb-99cc-49bd-b35d-77727ac2ea9c with Priority: HIGHEST for action port [ 1165.111645] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.111645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.111645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.112373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.112478] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.113499] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.113577] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.113637] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.113888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.114092] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.114209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.114281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.114418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.114584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.114701] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.117235] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe6574fb-99cc-49bd-b35d-77727ac2ea9c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.117235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe6574fb-99cc-49bd-b35d-77727ac2ea9c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.117235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe6574fb-99cc-49bd-b35d-77727ac2ea9c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.117450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe6574fb-99cc-49bd-b35d-77727ac2ea9c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.117450] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe6574fb-99cc-49bd-b35d-77727ac2ea9c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.450575] env[69499]: INFO networking_nsxv3.common.synchronization [req-3c96487d-387a-4d6c-ab90-de9c83e4f43d req-e7ce86d3-c6bd-459b-8bc3-8cd82c8bc25f tempest-ServersTestJSON-756379483 tempest-ServersTestJSON-756379483-project-member] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1165.451123] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1165.451449] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.451586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.451659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.451875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.452065] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.452174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.452241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.452416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.452497] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.452603] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.618882] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.619819] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.619927] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.620250] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe6574fb-99cc-49bd-b35d-77727ac2ea9c with status ACTIVE [ 1165.620412] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.620606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.620739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.620960] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.621067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.621307] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.621384] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.621489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.621890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.621890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.622053] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.622167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.622167] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.622321] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.622397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.622526] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe6574fb-99cc-49bd-b35d-77727ac2ea9c is going to be updated. [ 1165.642269] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.642398] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.642499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.642663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.642788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.642926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe6574fb-99cc-49bd-b35d-77727ac2ea9c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.954571] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.070215] env[69499]: INFO networking_nsxv3.common.synchronization [req-c43f023b-16bf-4b42-9037-e62ed6cac290 req-f251240b-dab1-4b21-bbb8-6ddcc0270559 tempest-ServerActionsTestOtherB-1591609705 tempest-ServerActionsTestOtherB-1591609705-project-member] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1166.070774] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1166.071138] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.071295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.071386] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.071640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.071840] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.071969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.072112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.072447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.072447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.072577] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.122471] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.456832] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.574673] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.574826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.574901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.575132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.575224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.575420] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.575518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.575573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.575722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.575796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.575882] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be updated. [ 1166.601510] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.601672] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.601734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.601861] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.601991] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.609752] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 2s [ 1166.626231] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.626382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.626445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.626560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.626640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.626730] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 is going to be created. [ 1166.647639] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.647814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.647814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.647956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.648117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.655660] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: UNINITIALIZED for 2s [ 1166.958263] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.958401] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.958486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.958694] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.958786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.958888] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1166.986890] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.987054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.987122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.987334] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.987469] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.995821] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1168.311675] env[69499]: INFO networking_nsxv3.common.synchronization [req-fcdfbecc-b73c-4ba5-8861-a61cbc0b6571 req-3e402ac7-d0cb-4394-a87a-99a2f98a3f13 tempest-ServerActionsTestJSON-629709431 tempest-ServerActionsTestJSON-629709431-project-member] Enqueued Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 1168.311675] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 1168.311675] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.311675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.311675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.312166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.312166] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.312166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.312166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.312295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.312295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.312380] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.610728] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-76 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.610944] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.611080] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.611362] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.611689] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.611867] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.612151] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.612390] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.612604] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.612823] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1168.612945] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.613073] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.613184] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.613299] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1168.613404] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.613539] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.627698] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1168.627849] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b deletion is rescheduled due to dependency. [ 1168.627955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.634569] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.634740] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1168.635288] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.635288] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-76" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.635396] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-614f6c6a-f5b6-4a94-b28d-6775bb30083c taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.635469] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-614f6c6a-f5b6-4a94-b28d-6775bb30083c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.635588] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-614f6c6a-f5b6-4a94-b28d-6775bb30083c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.636151] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-614f6c6a-f5b6-4a94-b28d-6775bb30083c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.636151] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('614f6c6a-f5b6-4a94-b28d-6775bb30083c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.663627] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: SUCCESS [ 1168.663869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.663928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.664142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.664319] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.664432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.664498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.664644] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.664722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.664802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.664886] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.818075] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.818221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.818294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.818524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.818619] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.818819] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.818921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.818981] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.819140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.819217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.819304] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 is going to be updated. [ 1168.853234] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.853411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.853500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.853731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.853885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.862836] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: IN_PROGRESS for 2s [ 1169.007634] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1169.007877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.138473] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.138720] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.138822] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.139142] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.139292] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.139471] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 614f6c6a-f5b6-4a94-b28d-6775bb30083c not found, creating... [ 1169.139733] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.139898] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.140027] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.140256] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.140402] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.140683] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.140843] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.140971] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.141254] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.141331] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.141516] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 614f6c6a-f5b6-4a94-b28d-6775bb30083c is going to be created. [ 1169.161963] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.161963] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.162187] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.162296] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.162542] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.162774] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-614f6c6a-f5b6-4a94-b28d-6775bb30083c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.167256] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.167378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.167426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.167585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.167737] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.167836] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.167892] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.168053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.168114] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.168195] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.168336] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.168423] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.168482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.168618] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.168750] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.168837] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.168897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.169041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.169115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.169193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.169278] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.671078] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc6ae0d0-f570-4d5f-9306-819f04632ed6: rpc.has_security_group_logging(os_id): False [ 1169.688135] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.688280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.688327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.688533] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.688620] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.688831] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.689041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.689041] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.689155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.689217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.689389] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.689495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.689558] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.689705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.689777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.689976] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.690097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.690162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.690302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.690374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.690463] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 is going to be created. [ 1169.743566] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.743728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.743779] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.744025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.744216] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.755017] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: IN_PROGRESS for 2s [ 1169.823842] env[69499]: INFO networking_nsxv3.common.synchronization [req-fcdfbecc-b73c-4ba5-8861-a61cbc0b6571 req-147d6352-0124-479a-beef-ac87c8dffed0 service nova] Enqueued Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_rules [ 1169.824064] env[69499]: INFO networking_nsxv3.common.synchronization [req-fcdfbecc-b73c-4ba5-8861-a61cbc0b6571 req-147d6352-0124-479a-beef-ac87c8dffed0 service nova] Enqueued Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 1169.824217] env[69499]: INFO networking_nsxv3.common.synchronization [req-fcdfbecc-b73c-4ba5-8861-a61cbc0b6571 req-147d6352-0124-479a-beef-ac87c8dffed0 service nova] Enqueued Resource ID: 614f6c6a-f5b6-4a94-b28d-6775bb30083c with Priority: HIGHEST for action port [ 1169.824827] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_rules [ 1169.824922] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 1169.825029] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614f6c6a-f5b6-4a94-b28d-6775bb30083c with Priority: HIGHEST for action port [ 1169.825304] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.825425] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.825493] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.825690] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.825769] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.826585] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.826744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.826902] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-614f6c6a-f5b6-4a94-b28d-6775bb30083c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.827019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-614f6c6a-f5b6-4a94-b28d-6775bb30083c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.827085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-614f6c6a-f5b6-4a94-b28d-6775bb30083c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.827246] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-614f6c6a-f5b6-4a94-b28d-6775bb30083c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.827326] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('614f6c6a-f5b6-4a94-b28d-6775bb30083c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.329255] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.329410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.330821] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 614f6c6a-f5b6-4a94-b28d-6775bb30083c with status ACTIVE [ 1170.331052] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.331188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.331258] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.331527] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.331633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.331832] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.331950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.332033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.332218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.332292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.332514] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.332631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.332671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.332832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.332926] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.332994] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 614f6c6a-f5b6-4a94-b28d-6775bb30083c is going to be updated. [ 1170.353421] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.353556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.353627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.353825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.353954] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.354117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-614f6c6a-f5b6-4a94-b28d-6775bb30083c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.510064] env[69499]: INFO networking_nsxv3.common.synchronization [req-c3c0c082-cda2-4d18-bbdf-20e82660d8f8 req-17805af4-6e67-4584-b896-b24f196f5469 tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f with Priority: HIGHEST for action security_group_members [ 1170.510589] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f with Priority: HIGHEST for action security_group_members [ 1170.511013] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-29ac832b-134e-49c9-ac8a-2171fbc0640f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.511775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.511974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.512448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.512738] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.512880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.512957] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.513159] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.513252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.513354] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29ac832b-134e-49c9-ac8a-2171fbc0640f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.872412] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: SUCCESS [ 1170.872684] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 deletion is rescheduled due to dependency. [ 1170.872791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.872993] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.873320] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.873490] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.873636] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.873720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.873904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.873988] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.874124] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.015341] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.015507] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.015582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.015814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.038032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.039967] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.039967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.039967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.039967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.039967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.039967] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f is going to be updated. [ 1171.062039] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.062368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.062473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.062977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.063306] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.071020] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f in Status: IN_PROGRESS for 2s [ 1171.320522] env[69499]: INFO networking_nsxv3.common.synchronization [req-cd496c25-9584-48f7-aba9-3617ac5697b3 req-975cead6-4716-4371-a446-7cee85ea39f9 tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1171.321110] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1171.321389] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.321525] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.321586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.321791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.321942] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.324357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.324357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.324357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.324357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.324357] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.376802] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.766176] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: SUCCESS [ 1171.766414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.825957] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.878125] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.063268] env[69499]: INFO networking_nsxv3.common.synchronization [None req-e35974b3-b6d0-45e2-9e5a-935e6d151168 tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1172.063866] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1172.064267] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.064442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.329123] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.380478] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.380478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.380478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.380662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.380662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.380750] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 is going to be updated. [ 1172.409217] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.409383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.409445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.409671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.409845] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.422529] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: IN_PROGRESS for 2s [ 1172.832331] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.832481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.832655] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.832763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.832857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.832958] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1172.861549] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.861703] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.861780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.861992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.862163] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.872302] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1173.080167] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f in Status: SUCCESS [ 1173.080480] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29ac832b-134e-49c9-ac8a-2171fbc0640f deletion is rescheduled due to dependency. [ 1173.080565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29ac832b-134e-49c9-ac8a-2171fbc0640f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.424093] env[69499]: INFO networking_nsxv3.common.synchronization [req-a42472ab-701c-442d-9c48-3e96337d74cb req-cc665212-19eb-474a-b3c6-3796924db2a5 tempest-ServersTestJSON-756379483 tempest-ServersTestJSON-756379483-project-member] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1173.424678] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGHEST for action security_group_members [ 1173.424993] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.425127] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.425191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.425405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.425564] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.425663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.425721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.425868] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.425947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.426174] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.928838] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.929188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.929188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.929374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.929374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.929610] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.929827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.929827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.929994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.929994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.930133] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be updated. [ 1173.954929] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.955148] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.955148] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.955296] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.955911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.962762] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: IN_PROGRESS for 2s [ 1174.431108] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: SUCCESS [ 1174.431670] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.431670] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.431933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.431993] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.432153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.432153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.432323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.432411] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.432466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.432570] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.879585] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1174.879808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.879973] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.880218] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.880403] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.880515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.880576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.880726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.880806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.880896] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.934896] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.951829] env[69499]: INFO networking_nsxv3.common.synchronization [req-e682c1ee-a22d-466a-aabb-902b169ec141 req-c6869e32-7285-48c6-8afa-101934b34087 tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 54331bd8-45ec-4f27-a691-e602cc0be614 with Priority: HIGHEST for action security_group_members [ 1174.952515] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54331bd8-45ec-4f27-a691-e602cc0be614 with Priority: HIGHEST for action security_group_members [ 1174.953169] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-54331bd8-45ec-4f27-a691-e602cc0be614 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.953302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.953367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.953572] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.953730] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.953830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.953888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.954046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.954130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.954224] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54331bd8-45ec-4f27-a691-e602cc0be614',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.383538] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.383706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.383782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.384016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.384301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.384381] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.384457] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.384521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.384724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.384809] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.384911] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1175.411721] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.411903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.411977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.412212] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.412361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.420077] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1175.437473] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0fc2518-1857-49ca-8dcd-c34aaa8c5c22: rpc.has_security_group_logging(os_id): False [ 1175.454368] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.454851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.454851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.454851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.454851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.455368] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.455488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.455552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.455717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.455802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.455893] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 is going to be updated. [ 1175.457050] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.457173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.457227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.457373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.457999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.457999] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.457999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.457999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.457999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.457999] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.458316] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54331bd8-45ec-4f27-a691-e602cc0be614 is going to be updated. [ 1175.484828] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.485036] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.485113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.485322] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.485465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.493612] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54331bd8-45ec-4f27-a691-e602cc0be614 in Status: IN_PROGRESS for 2s [ 1175.530266] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.530398] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.530473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.530684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.530826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.542045] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: IN_PROGRESS for 2s [ 1175.973588] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf01aae2-c409-4ed9-940b-99698ec3968f in Status: SUCCESS [ 1175.973917] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f deletion is rescheduled due to dependency. [ 1175.974144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.220092] env[69499]: INFO networking_nsxv3.common.synchronization [req-416fc8ea-3740-4769-bb96-4b0bae0d9688 req-428d5d75-98db-48df-be6a-fd993e9a1bda tempest-ServerActionsTestOtherB-1591609705 tempest-ServerActionsTestOtherB-1591609705-project-member] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1177.220828] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1177.221284] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.221476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.221611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.221918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.222194] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.222375] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.222495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.222761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.222916] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.223126] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.429908] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1177.430102] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 deletion is rescheduled due to dependency. [ 1177.430216] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.502705] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54331bd8-45ec-4f27-a691-e602cc0be614 in Status: SUCCESS [ 1177.502705] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54331bd8-45ec-4f27-a691-e602cc0be614 deletion is rescheduled due to dependency. [ 1177.502860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54331bd8-45ec-4f27-a691-e602cc0be614" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.531679] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-728 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.531957] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.532140] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.532460] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.532776] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.532987] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.533179] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.533447] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.533645] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.533912] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.534065] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.534185] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.534300] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.534421] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.534528] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.534669] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.552792] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.552792] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.552792] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.552966] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.553349] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.553479] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.553643] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.553965] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.554126] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.555659] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: SUCCESS [ 1177.555853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.725705] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.725705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.725705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.725986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.725986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.726938] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.726938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.726938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.726938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.726938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.726938] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be updated. [ 1177.748835] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.748995] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.749053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.749299] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.749437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.757386] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 2s [ 1177.983090] env[69499]: INFO networking_nsxv3.common.synchronization [req-e846b499-8014-4c33-98bf-721c9f0dcdbe req-78c5e806-f51b-4e81-b69d-87f069b7f4b2 tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 with Priority: HIGHEST for action security_group_members [ 1177.983607] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 with Priority: HIGHEST for action security_group_members [ 1177.983914] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d458bfd-aa6f-4b52-9c71-7e427269cf82 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.984066] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.984132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.984336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.984495] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.984593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.984669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.984800] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.984882] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.984974] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d458bfd-aa6f-4b52-9c71-7e427269cf82',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.061029] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.061029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.061029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.061029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.061029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.061029] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96 not found, creating... [ 1178.061029] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.061029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.061029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.061029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.061029] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.061779] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.061779] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.061779] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.061779] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.061779] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.062608] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96 is going to be created. [ 1178.081463] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.081830] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.081830] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.082122] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.082349] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.082570] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.490708] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.490708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.490708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.490708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.490708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.491245] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.491245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.491245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.491245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.491389] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.491389] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 is going to be updated. [ 1178.525551] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.525688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.525804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.526108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.526265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.534800] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 in Status: IN_PROGRESS for 2s [ 1178.956443] env[69499]: INFO networking_nsxv3.common.synchronization [req-416fc8ea-3740-4769-bb96-4b0bae0d9688 req-1aee01a6-8c3e-40ad-9f3c-419063b6c7f8 service nova] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_rules [ 1178.956443] env[69499]: INFO networking_nsxv3.common.synchronization [req-416fc8ea-3740-4769-bb96-4b0bae0d9688 req-1aee01a6-8c3e-40ad-9f3c-419063b6c7f8 service nova] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1178.956443] env[69499]: INFO networking_nsxv3.common.synchronization [req-416fc8ea-3740-4769-bb96-4b0bae0d9688 req-1aee01a6-8c3e-40ad-9f3c-419063b6c7f8 service nova] Enqueued Resource ID: bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96 with Priority: HIGHEST for action port [ 1178.957103] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_rules [ 1178.957103] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1178.957103] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96 with Priority: HIGHEST for action port [ 1178.957498] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.957631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.957710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.957884] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.957959] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.958837] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.958906] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.959114] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.959541] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.959964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.959964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.959964] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.462437] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96 with status ACTIVE [ 1179.462780] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.462920] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.462992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.463232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.463324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.463502] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.463602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.463667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.463815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.463893] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.464095] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.464190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.464250] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.464390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.464465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.464549] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96 is going to be updated. [ 1179.465771] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.465869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.483818] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.484051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.484051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.484258] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.484394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.484551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bab20c3e-b7a9-4c93-b6c8-ffb6aa954b96" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.767159] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1179.767159] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b deletion is rescheduled due to dependency. [ 1179.767159] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.767159] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.767159] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.767159] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.767642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.767642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.767642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.767642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.767780] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.269741] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.543273] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 in Status: SUCCESS [ 1180.543453] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 deletion is rescheduled due to dependency. [ 1180.543567] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.573564] env[69499]: INFO networking_nsxv3.common.synchronization [None req-22bc4d11-8630-4ee5-bcab-1cbb0a64bfac tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_rules [ 1180.573619] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_rules [ 1180.573961] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22e872cc-d333-48f4-bf51-8df73b1a70e3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.574299] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.574299] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.574385] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.574660] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.644152] env[69499]: INFO networking_nsxv3.common.synchronization [None req-b5279413-8481-42b5-8d9d-93a98a61de1a tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_rules [ 1180.644654] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_rules [ 1180.644977] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22e872cc-d333-48f4-bf51-8df73b1a70e3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.645121] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.775482] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.093102] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.093272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.093321] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.093515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.093606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.093704] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 already deleted. [ 1181.093786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.094020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.094233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.094310] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.278706] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.278861] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.278966] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.279172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.279262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.279367] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be updated. [ 1181.318495] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.318648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.318719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.318931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.319098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.337211] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 2s [ 1181.614023] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.614188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.614260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.614466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.614554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.614655] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 already deleted. [ 1181.614735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.652055] env[69499]: INFO networking_nsxv3.common.synchronization [None req-966215e6-5799-42c3-b1ee-f307b46beea8 None None] Enqueued Resource ID: 572829f1-23be-410e-84f9-e1ec401027e0 with Priority: HIGHEST for action port [ 1182.652319] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 572829f1-23be-410e-84f9-e1ec401027e0 with Priority: HIGHEST for action port [ 1182.652918] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-572829f1-23be-410e-84f9-e1ec401027e0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.653095] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-572829f1-23be-410e-84f9-e1ec401027e0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.653197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-572829f1-23be-410e-84f9-e1ec401027e0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.653456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-572829f1-23be-410e-84f9-e1ec401027e0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.653541] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('572829f1-23be-410e-84f9-e1ec401027e0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.019452] env[69499]: INFO networking_nsxv3.common.synchronization [req-890d192b-1107-48a8-9ee6-1c0b28314048 req-b1670a5a-b1db-439e-a5f9-8bee92834576 tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_members [ 1183.020193] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_members [ 1183.022940] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b93818-38bc-46b2-af63-51d39fce766c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.022940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.022940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.022940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.022940] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.022940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.022940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.022940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.022940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.023414] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.158378] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 572829f1-23be-410e-84f9-e1ec401027e0 [ 1183.158865] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.158865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.158865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.159067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.159260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.159260] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:572829f1-23be-410e-84f9-e1ec401027e0 already deleted. [ 1183.159365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-572829f1-23be-410e-84f9-e1ec401027e0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.348019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1183.348019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.348019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.348019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.348019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.348019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.348019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.348566] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.348566] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.348566] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.348566] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.481181] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.481181] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.481181] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.481396] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.481643] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.481832] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.481957] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.482348] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.482509] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.482729] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1183.482852] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1183.482964] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1183.483089] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1183.483203] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1183.483311] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1183.483446] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1183.501923] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1183.502153] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1183.502300] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1183.503227] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.503227] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.503227] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.503227] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.503495] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.503534] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbac7a6a-367a-4efa-a0c9-e4294d98c6ff',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.525267] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.525379] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.525450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.525660] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.544493] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.544742] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.544867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.544938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.545156] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.545243] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.545334] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2b93818-38bc-46b2-af63-51d39fce766c is going to be updated. [ 1183.573767] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.573942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.574020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.575434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.575434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.584622] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2b93818-38bc-46b2-af63-51d39fce766c in Status: IN_PROGRESS for 2s [ 1183.850888] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.005786] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.006040] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.006176] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.006494] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.006652] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.006813] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port bbac7a6a-367a-4efa-a0c9-e4294d98c6ff not found, creating... [ 1184.007094] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.007259] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.007394] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.007629] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.007787] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.008107] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.008273] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.008394] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.008623] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.008769] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.008915] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: bbac7a6a-367a-4efa-a0c9-e4294d98c6ff is going to be created. [ 1184.028258] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.028478] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.028622] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.028855] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.029099] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.029316] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.355775] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 717f63b4-82e8-4749-8d24-1abe7790389b: rpc.has_security_group_logging(os_id): False [ 1184.373827] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.373987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.374113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.374483] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.374585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.374880] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.375039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.375106] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.375274] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.375353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.375543] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be updated. [ 1184.428700] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.428902] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.428969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.429161] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.429437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.443506] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 2s [ 1184.732758] env[69499]: INFO networking_nsxv3.common.synchronization [req-890d192b-1107-48a8-9ee6-1c0b28314048 req-a4b6ad27-ca48-47e2-a100-c9ca25121d2f service nova] Enqueued Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_rules [ 1184.732954] env[69499]: INFO networking_nsxv3.common.synchronization [req-890d192b-1107-48a8-9ee6-1c0b28314048 req-a4b6ad27-ca48-47e2-a100-c9ca25121d2f service nova] Enqueued Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_members [ 1184.733121] env[69499]: INFO networking_nsxv3.common.synchronization [req-890d192b-1107-48a8-9ee6-1c0b28314048 req-a4b6ad27-ca48-47e2-a100-c9ca25121d2f service nova] Enqueued Resource ID: bbac7a6a-367a-4efa-a0c9-e4294d98c6ff with Priority: HIGHEST for action port [ 1184.733358] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_rules [ 1184.733486] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_members [ 1184.734147] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbac7a6a-367a-4efa-a0c9-e4294d98c6ff with Priority: HIGHEST for action port [ 1184.740913] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2b93818-38bc-46b2-af63-51d39fce766c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.741061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.741133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.741434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.741434] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.746020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b93818-38bc-46b2-af63-51d39fce766c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.746020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.746020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.746020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.746020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.746020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.746020] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbac7a6a-367a-4efa-a0c9-e4294d98c6ff',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.766654] env[69499]: INFO networking_nsxv3.common.synchronization [None req-317725ed-9467-4fa5-8281-4413f165ee45 None None] Enqueued Resource ID: cca5092c-98f4-4b19-a693-b063434c4fc7 with Priority: HIGHEST for action port [ 1184.767451] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca5092c-98f4-4b19-a693-b063434c4fc7 with Priority: HIGHEST for action port [ 1184.767913] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-cca5092c-98f4-4b19-a693-b063434c4fc7 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.768076] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cca5092c-98f4-4b19-a693-b063434c4fc7" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.768197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cca5092c-98f4-4b19-a693-b063434c4fc7" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.768453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cca5092c-98f4-4b19-a693-b063434c4fc7" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.768566] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cca5092c-98f4-4b19-a693-b063434c4fc7',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.013609] env[69499]: INFO networking_nsxv3.common.synchronization [None req-0f48b3ea-554e-419e-973b-47b8ca1786c2 tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: b776cc4b-727c-486a-84a0-2fec84d7f56d with Priority: HIGHEST for action security_group_rules [ 1185.014241] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b776cc4b-727c-486a-84a0-2fec84d7f56d with Priority: HIGHEST for action security_group_rules [ 1185.014587] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b776cc4b-727c-486a-84a0-2fec84d7f56d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.014741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.014836] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.015123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.015210] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b776cc4b-727c-486a-84a0-2fec84d7f56d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.110284] env[69499]: INFO networking_nsxv3.common.synchronization [None req-873e035d-8231-49d2-8e53-b2d5a2d77d37 tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: b776cc4b-727c-486a-84a0-2fec84d7f56d with Priority: HIGHEST for action security_group_rules [ 1185.111444] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b776cc4b-727c-486a-84a0-2fec84d7f56d with Priority: HIGHEST for action security_group_rules [ 1185.111883] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b776cc4b-727c-486a-84a0-2fec84d7f56d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.112054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.245343] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b93818-38bc-46b2-af63-51d39fce766c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.245520] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.247896] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbac7a6a-367a-4efa-a0c9-e4294d98c6ff with status ACTIVE [ 1185.248149] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.248329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.248457] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.248737] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.248879] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.249131] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.249274] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.249372] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.249607] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.249736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.250045] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.250182] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.250266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.250454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.250548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.250664] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbac7a6a-367a-4efa-a0c9-e4294d98c6ff is going to be updated. [ 1185.272388] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.272542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.272608] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.272811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.272944] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.273205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.273419] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cca5092c-98f4-4b19-a693-b063434c4fc7 [ 1185.273614] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.273725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.273785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.273934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.274035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.274106] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cca5092c-98f4-4b19-a693-b063434c4fc7 already deleted. [ 1185.274200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cca5092c-98f4-4b19-a693-b063434c4fc7" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.536442] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.536593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.536662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.536889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.536976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.537089] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b776cc4b-727c-486a-84a0-2fec84d7f56d already deleted. [ 1185.537175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.537325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.537478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.537563] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b776cc4b-727c-486a-84a0-2fec84d7f56d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.592659] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2b93818-38bc-46b2-af63-51d39fce766c in Status: SUCCESS [ 1185.592837] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2b93818-38bc-46b2-af63-51d39fce766c deletion is rescheduled due to dependency. [ 1185.592940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.593112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.593331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.593538] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.593656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.593721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.593885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.593967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.594098] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.062218] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.063017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.063017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.063017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.063017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.063173] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b776cc4b-727c-486a-84a0-2fec84d7f56d already deleted. [ 1186.064169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.095910] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.455071] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1186.455071] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.598675] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.827044] env[69499]: INFO networking_nsxv3.common.synchronization [req-9f9f1486-9d2b-4f42-8e56-fc664326c92d req-2c56c840-4639-4f5f-b732-00c50b753e18 tempest-ServerRescueTestJSON-863883418 tempest-ServerRescueTestJSON-863883418-project-member] Enqueued Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_members [ 1186.827885] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_members [ 1186.828224] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.828341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.828408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.828604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.828755] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.828861] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.828921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.829081] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.829171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.829832] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.104589] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.104904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.104904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.105173] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.105317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.105472] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2b93818-38bc-46b2-af63-51d39fce766c is going to be updated. [ 1187.134858] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.136710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.136710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.136948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.137390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.145489] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2b93818-38bc-46b2-af63-51d39fce766c in Status: IN_PROGRESS for 2s [ 1187.158901] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-827 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.159114] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-827" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.159244] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-827" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.159510] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-827" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.159819] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.159968] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.160106] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.160329] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.160479] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.160687] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.160901] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.160957] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.161068] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.161192] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.161303] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.161438] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.179232] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.179232] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1187.179232] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.179232] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-827" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.179232] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-d64576eb-4fb1-41fc-b8e7-047deb5cb3eb taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.181844] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-d64576eb-4fb1-41fc-b8e7-047deb5cb3eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.181844] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-d64576eb-4fb1-41fc-b8e7-047deb5cb3eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.181844] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-d64576eb-4fb1-41fc-b8e7-047deb5cb3eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.181844] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d64576eb-4fb1-41fc-b8e7-047deb5cb3eb',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.340512] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.684838] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.684838] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.684838] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.684838] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.684838] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.685127] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port d64576eb-4fb1-41fc-b8e7-047deb5cb3eb not found, creating... [ 1187.685301] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.685455] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.685572] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.685790] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.685926] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.686228] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.686382] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.686497] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.686705] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.686839] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.686977] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: d64576eb-4fb1-41fc-b8e7-047deb5cb3eb is going to be created. [ 1187.705844] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.707580] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.707580] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.707580] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.707580] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.707580] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-d64576eb-4fb1-41fc-b8e7-047deb5cb3eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.842285] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.344460] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.344766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.344766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.344937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.345011] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.345138] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 is going to be updated. [ 1188.377623] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.377825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.377868] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.378075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.378226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.388166] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: IN_PROGRESS for 2s [ 1188.445779] env[69499]: INFO networking_nsxv3.common.synchronization [req-9f9f1486-9d2b-4f42-8e56-fc664326c92d req-3be8aaf8-0f9d-4345-b05f-0bfa2d7447c4 service nova] Enqueued Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_rules [ 1188.445960] env[69499]: INFO networking_nsxv3.common.synchronization [req-9f9f1486-9d2b-4f42-8e56-fc664326c92d req-3be8aaf8-0f9d-4345-b05f-0bfa2d7447c4 service nova] Enqueued Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_members [ 1188.446163] env[69499]: INFO networking_nsxv3.common.synchronization [req-9f9f1486-9d2b-4f42-8e56-fc664326c92d req-3be8aaf8-0f9d-4345-b05f-0bfa2d7447c4 service nova] Enqueued Resource ID: d64576eb-4fb1-41fc-b8e7-047deb5cb3eb with Priority: HIGHEST for action port [ 1188.446367] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_rules [ 1188.446680] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_members [ 1188.446680] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d64576eb-4fb1-41fc-b8e7-047deb5cb3eb with Priority: HIGHEST for action port [ 1188.447327] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.447386] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.449037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.449037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.449037] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.449363] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.449465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.449808] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-d64576eb-4fb1-41fc-b8e7-047deb5cb3eb taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.449943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d64576eb-4fb1-41fc-b8e7-047deb5cb3eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.449994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d64576eb-4fb1-41fc-b8e7-047deb5cb3eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.450211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d64576eb-4fb1-41fc-b8e7-047deb5cb3eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.450304] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d64576eb-4fb1-41fc-b8e7-047deb5cb3eb',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.950256] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.950453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.951837] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d64576eb-4fb1-41fc-b8e7-047deb5cb3eb with status ACTIVE [ 1188.952046] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.952155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.952223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.952430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.952521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.952696] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.952817] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.952887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.953071] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.953153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.953340] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.953433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.953496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.953654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.953706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.953801] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d64576eb-4fb1-41fc-b8e7-047deb5cb3eb is going to be updated. [ 1188.975152] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.975288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.975342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.975531] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.975678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.975826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d64576eb-4fb1-41fc-b8e7-047deb5cb3eb" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.091223] env[69499]: INFO networking_nsxv3.common.synchronization [req-779d7c07-f4f5-4221-98ed-1099a39a2c94 req-6b504d6f-0e8e-427e-9f2e-e43194d2ff83 tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_members [ 1189.091836] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_members [ 1189.092216] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-22e872cc-d333-48f4-bf51-8df73b1a70e3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.092407] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.092512] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.092804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.093012] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.093147] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.093241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.093454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.093650] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.093783] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.153972] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2b93818-38bc-46b2-af63-51d39fce766c in Status: SUCCESS [ 1189.154214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.154373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.154594] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.154786] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.154903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.154969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.155140] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.155223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.155308] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.155397] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.458142] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.458142] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.458142] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.458142] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.458142] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.458142] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.458142] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.458142] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.458973] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.459392] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.459646] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1189.459911] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1189.462332] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1189.462332] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.462332] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1189.462332] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1189.478547] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1189.478547] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1189.478676] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1189.478825] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.479449] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-e64d85bd-4521-4383-91db-5079182bc715 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.479664] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-e64d85bd-4521-4383-91db-5079182bc715" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.479800] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-e64d85bd-4521-4383-91db-5079182bc715" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.480125] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-e64d85bd-4521-4383-91db-5079182bc715" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.480274] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64d85bd-4521-4383-91db-5079182bc715',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.596149] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.596309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.596383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.596599] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.596688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.596962] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.597073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.597138] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.597288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.597364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.597448] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 already deleted. [ 1189.597528] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.657738] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b93818-38bc-46b2-af63-51d39fce766c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.657887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.657952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.658137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.658299] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.658398] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.658455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.658600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.658682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.658768] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.658916] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b93818-38bc-46b2-af63-51d39fce766c taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.659014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.659077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.659219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.659356] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.659447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.660060] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.660060] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.660060] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.660060] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.660239] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.983094] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.983402] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.983571] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.983916] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.984124] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.984310] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port e64d85bd-4521-4383-91db-5079182bc715 not found, creating... [ 1189.984587] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.984753] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.984874] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.985125] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.985272] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.985559] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.985719] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.985834] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.986122] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.986204] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.986367] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: e64d85bd-4521-4383-91db-5079182bc715 is going to be created. [ 1190.006275] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.006495] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.006623] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.006909] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.007167] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.007425] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-e64d85bd-4521-4383-91db-5079182bc715" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.162371] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2b93818-38bc-46b2-af63-51d39fce766c: rpc.has_security_group_logging(os_id): False [ 1190.190685] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.190911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.190911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.191112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.191206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.191404] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.191506] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.191569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.191718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.191819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.192041] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.192139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.192202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.192344] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.192419] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.192594] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.192686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.192768] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.192917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.192996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.193098] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2b93818-38bc-46b2-af63-51d39fce766c is going to be updated. [ 1190.283768] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.283946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.283946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.284232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.284373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.296743] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2b93818-38bc-46b2-af63-51d39fce766c in Status: IN_PROGRESS for 2s [ 1190.398089] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: SUCCESS [ 1190.398286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.398496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.398714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.398900] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.399055] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.399092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.399242] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.399322] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.399416] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.745944] env[69499]: INFO networking_nsxv3.common.synchronization [req-779d7c07-f4f5-4221-98ed-1099a39a2c94 req-a6fb2b1f-1c8c-48eb-be5f-bc53ce7f9fdb service nova] Enqueued Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_rules [ 1190.746202] env[69499]: INFO networking_nsxv3.common.synchronization [req-779d7c07-f4f5-4221-98ed-1099a39a2c94 req-a6fb2b1f-1c8c-48eb-be5f-bc53ce7f9fdb service nova] Enqueued Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_members [ 1190.746319] env[69499]: INFO networking_nsxv3.common.synchronization [req-779d7c07-f4f5-4221-98ed-1099a39a2c94 req-a6fb2b1f-1c8c-48eb-be5f-bc53ce7f9fdb service nova] Enqueued Resource ID: e64d85bd-4521-4383-91db-5079182bc715 with Priority: HIGHEST for action port [ 1190.746526] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_rules [ 1190.746651] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_members [ 1190.746746] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64d85bd-4521-4383-91db-5079182bc715 with Priority: HIGHEST for action port [ 1190.747278] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22e872cc-d333-48f4-bf51-8df73b1a70e3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.747404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.747471] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.747666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.747745] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.749606] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-22e872cc-d333-48f4-bf51-8df73b1a70e3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.749739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.749870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.750055] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.750210] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.750304] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.750370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.750511] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.750595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.750679] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.751412] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e64d85bd-4521-4383-91db-5079182bc715 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.751511] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e64d85bd-4521-4383-91db-5079182bc715" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.751576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e64d85bd-4521-4383-91db-5079182bc715" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.751724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e64d85bd-4521-4383-91db-5079182bc715" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.751861] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64d85bd-4521-4383-91db-5079182bc715',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.901144] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.253701] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.254855] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-22e872cc-d333-48f4-bf51-8df73b1a70e3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.255021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.256473] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e64d85bd-4521-4383-91db-5079182bc715 with status ACTIVE [ 1191.256648] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.256786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.256954] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.257227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.257361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.257584] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.257732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.257815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.257967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.258062] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.258248] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.258341] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.258399] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.258538] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.258611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.258692] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e64d85bd-4521-4383-91db-5079182bc715 is going to be updated. [ 1191.278321] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.278509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.278562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.278735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.278867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.279029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e64d85bd-4521-4383-91db-5079182bc715" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.319081] env[69499]: INFO networking_nsxv3.common.synchronization [req-26e9de44-7a4a-431c-923c-c95657f7f56a req-4a5ab96d-30e9-49dc-85b6-c3a1b7b84250 tempest-ServersNegativeTestJSON-1527094857 tempest-ServersNegativeTestJSON-1527094857-project-member] Enqueued Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_members [ 1191.319282] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_members [ 1191.319558] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.319683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.319744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.320033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.320202] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.320309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.320364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.320522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.320605] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.320694] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.403171] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.610041] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-365 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.610206] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-365" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.610352] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-365" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.610691] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-365" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.611073] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.611303] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.611431] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.611682] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.611903] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.612147] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1191.612268] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1191.612382] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1191.612496] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1191.612609] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1191.612720] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1191.612860] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1191.632152] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1191.632347] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1191.632461] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1191.632644] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-365" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.632980] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.633176] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.633343] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.633648] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.633791] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d05833cf-adbb-4f7c-a9f7-c544d6fae9d8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.756521] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.823623] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.824559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.824559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.824559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.824559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.824790] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.824790] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.824790] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.824900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.824990] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.825091] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 already deleted. [ 1191.825174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.909984] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.909984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.909984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.909984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.909984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.909984] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 is going to be updated. [ 1191.937042] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.937193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.937237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.937440] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.937584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.946204] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: IN_PROGRESS for 2s [ 1192.137385] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.137619] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.137744] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.138090] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.138223] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.138396] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 not found, creating... [ 1192.138663] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.138828] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.138948] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.139194] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.139354] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.139662] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.139852] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.139995] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.140215] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.140354] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.140497] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 is going to be created. [ 1192.183576] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.183799] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.183928] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.184226] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.184459] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.184685] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.258738] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.258942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.259017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.259276] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.259372] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.259479] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 is going to be created. [ 1192.301765] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.301997] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.302110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.302282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.302464] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.314060] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 in Status: UNINITIALIZED for 2s [ 1192.319799] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2b93818-38bc-46b2-af63-51d39fce766c in Status: SUCCESS [ 1192.319986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.912696] env[69499]: INFO networking_nsxv3.common.synchronization [req-26e9de44-7a4a-431c-923c-c95657f7f56a req-c6ff16f4-876a-4a69-890c-53d324c19877 service nova] Enqueued Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_rules [ 1192.912992] env[69499]: INFO networking_nsxv3.common.synchronization [req-26e9de44-7a4a-431c-923c-c95657f7f56a req-c6ff16f4-876a-4a69-890c-53d324c19877 service nova] Enqueued Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_members [ 1192.913158] env[69499]: INFO networking_nsxv3.common.synchronization [req-26e9de44-7a4a-431c-923c-c95657f7f56a req-c6ff16f4-876a-4a69-890c-53d324c19877 service nova] Enqueued Resource ID: d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 with Priority: HIGHEST for action port [ 1192.913933] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_rules [ 1192.914127] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_members [ 1192.914286] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 with Priority: HIGHEST for action port [ 1192.914618] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.914791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.914886] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.915215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.915304] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.916140] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.916281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.916348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.916859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.917044] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.917147] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.917211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.917364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.917450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.917538] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.918273] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.918382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.918448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.918597] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.918671] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d05833cf-adbb-4f7c-a9f7-c544d6fae9d8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.420606] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.423764] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.423764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.423764] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 with status ACTIVE [ 1193.423764] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.423764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.423764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.423764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.423764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.423764] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.423764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.423764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.424638] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.426974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.426974] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.426974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.426974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.426974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.426974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.426974] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 is going to be updated. [ 1193.446310] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.446310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.446310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.446310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.446310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.446310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.928728] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.945221] env[69499]: INFO networking_nsxv3.common.synchronization [req-5b933514-6011-48f8-b7ce-b1b2b808f392 req-5c2197a8-e8fe-47a4-bc48-cc257de556f3 tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: b776cc4b-727c-486a-84a0-2fec84d7f56d with Priority: HIGHEST for action security_group_members [ 1193.945221] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b776cc4b-727c-486a-84a0-2fec84d7f56d with Priority: HIGHEST for action security_group_members [ 1193.949434] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b776cc4b-727c-486a-84a0-2fec84d7f56d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.949434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.949434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.949434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.949434] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.949434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.949434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.949897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.949897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.949954] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b776cc4b-727c-486a-84a0-2fec84d7f56d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.961705] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: SUCCESS [ 1193.962096] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.962202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.962439] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.962682] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.962839] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.962995] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.963089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.963145] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.963498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.963624] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.330524] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 in Status: SUCCESS [ 1194.330731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.330889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.331228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.331448] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.331569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.331636] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.331796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.331957] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.332074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.332167] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.351386] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.351582] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.351710] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.352324] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.352423] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.352593] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.352712] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.352979] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.353193] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.353414] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1194.353555] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1194.353687] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1194.353810] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1194.353929] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1194.354075] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1194.354270] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1194.373310] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1194.373486] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1194.373627] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1194.373836] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-166" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.374172] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-e11b606d-34f2-46fb-98e2-9dcb0d2276f9 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.374339] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-e11b606d-34f2-46fb-98e2-9dcb0d2276f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.374462] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-e11b606d-34f2-46fb-98e2-9dcb0d2276f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.374762] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-e11b606d-34f2-46fb-98e2-9dcb0d2276f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.374901] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e11b606d-34f2-46fb-98e2-9dcb0d2276f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.431316] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.431489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.431546] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.431855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.431952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.432103] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 is going to be created. [ 1194.454462] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.454640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.454640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.454871] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.454976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.455186] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.455288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.455358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.455515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.455676] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.455676] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b776cc4b-727c-486a-84a0-2fec84d7f56d already deleted. [ 1194.455760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.458972] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.459093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.459163] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.459318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.459467] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.465949] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.466077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.466149] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.466304] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.466452] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.466588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.466632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.466801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.466898] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.467010] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.467192] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.467298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.467374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.467524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.467689] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.467801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.467866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.468040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.468135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.468224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.468313] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.469765] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: UNINITIALIZED for 2s [ 1194.725409] env[69499]: INFO networking_nsxv3.common.synchronization [req-e952a8b8-ab49-4151-ba8f-bb58cb64ab22 req-5fe9381a-03fe-4091-9e5d-cdf369d0759e tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_members [ 1194.725950] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b93818-38bc-46b2-af63-51d39fce766c with Priority: HIGHEST for action security_group_members [ 1194.726278] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b93818-38bc-46b2-af63-51d39fce766c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.726405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.726473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.726904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.727089] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.727267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.727399] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.727549] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.727634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.727723] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2b93818-38bc-46b2-af63-51d39fce766c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.834569] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.877580] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.877823] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.877939] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.878285] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.878446] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.878610] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port e11b606d-34f2-46fb-98e2-9dcb0d2276f9 not found, creating... [ 1194.878921] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.879126] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.879253] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.879490] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.879659] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.880120] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.880311] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.880435] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.880653] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.880827] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.880936] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: e11b606d-34f2-46fb-98e2-9dcb0d2276f9 is going to be created. [ 1194.899516] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.899915] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.899915] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.900244] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.900492] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.900737] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-e11b606d-34f2-46fb-98e2-9dcb0d2276f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.971143] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc6ae0d0-f570-4d5f-9306-819f04632ed6: rpc.has_security_group_logging(os_id): False [ 1195.012134] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.012369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.012369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.012687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.012687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.012908] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.013043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.013203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.013316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.013372] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.013541] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.013634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.013696] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.013839] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.013917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.014178] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.014267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.014334] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.014479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.014556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.014645] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 is going to be updated. [ 1195.050880] env[69499]: INFO networking_nsxv3.common.synchronization [req-e952a8b8-ab49-4151-ba8f-bb58cb64ab22 req-5fe9381a-03fe-4091-9e5d-cdf369d0759e tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: bbac7a6a-367a-4efa-a0c9-e4294d98c6ff with Priority: HIGHEST for action port [ 1195.051575] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbac7a6a-367a-4efa-a0c9-e4294d98c6ff with Priority: HIGHEST for action port [ 1195.051959] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.052107] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.052244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.052606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.052697] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbac7a6a-367a-4efa-a0c9-e4294d98c6ff',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.093717] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.093893] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.093986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.094331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.094404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.117261] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: IN_PROGRESS for 2s [ 1195.229642] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.229838] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.229911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.231029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.231029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.231029] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.231029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.231029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.231029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.231029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.231029] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2b93818-38bc-46b2-af63-51d39fce766c is going to be updated. [ 1195.285751] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.285929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.286015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.286246] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.286389] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.296621] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2b93818-38bc-46b2-af63-51d39fce766c in Status: IN_PROGRESS for 2s [ 1195.337078] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22e872cc-d333-48f4-bf51-8df73b1a70e3: rpc.has_security_group_logging(os_id): False [ 1195.355809] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.355960] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.356046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.356265] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.356358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.356609] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.356710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.356775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.356924] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.357008] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.357100] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 is going to be created. [ 1195.413696] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.413863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.413910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.414127] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.414335] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.427399] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 in Status: IN_PROGRESS for 2s [ 1195.559984] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbac7a6a-367a-4efa-a0c9-e4294d98c6ff with status ACTIVE [ 1195.560310] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.560561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.560561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.560687] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.560782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.560955] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.561068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.561125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.561277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.561388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.561545] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.561612] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.561668] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.561808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.562078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.562078] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbac7a6a-367a-4efa-a0c9-e4294d98c6ff is going to be updated. [ 1195.581699] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.581919] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.582028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.582210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.582323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.582468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbac7a6a-367a-4efa-a0c9-e4294d98c6ff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.677521] env[69499]: INFO networking_nsxv3.common.synchronization [req-5b933514-6011-48f8-b7ce-b1b2b808f392 req-3d1346bd-5106-46af-825d-0e1ff455097f service nova] Enqueued Resource ID: b776cc4b-727c-486a-84a0-2fec84d7f56d with Priority: HIGHEST for action security_group_rules [ 1195.677707] env[69499]: INFO networking_nsxv3.common.synchronization [req-5b933514-6011-48f8-b7ce-b1b2b808f392 req-3d1346bd-5106-46af-825d-0e1ff455097f service nova] Enqueued Resource ID: b776cc4b-727c-486a-84a0-2fec84d7f56d with Priority: HIGHEST for action security_group_members [ 1195.677855] env[69499]: INFO networking_nsxv3.common.synchronization [req-5b933514-6011-48f8-b7ce-b1b2b808f392 req-3d1346bd-5106-46af-825d-0e1ff455097f service nova] Enqueued Resource ID: e11b606d-34f2-46fb-98e2-9dcb0d2276f9 with Priority: HIGHEST for action port [ 1195.678101] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b776cc4b-727c-486a-84a0-2fec84d7f56d with Priority: HIGHEST for action security_group_rules [ 1195.678245] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b776cc4b-727c-486a-84a0-2fec84d7f56d with Priority: HIGHEST for action security_group_members [ 1195.678347] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e11b606d-34f2-46fb-98e2-9dcb0d2276f9 with Priority: HIGHEST for action port [ 1195.678956] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b776cc4b-727c-486a-84a0-2fec84d7f56d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.681279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.681279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.681657] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.681657] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b776cc4b-727c-486a-84a0-2fec84d7f56d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.682567] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b776cc4b-727c-486a-84a0-2fec84d7f56d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.684180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.684262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.684526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.684670] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.684813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.687944] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.687944] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.687944] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.687944] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b776cc4b-727c-486a-84a0-2fec84d7f56d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.690621] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-e11b606d-34f2-46fb-98e2-9dcb0d2276f9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.690753] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e11b606d-34f2-46fb-98e2-9dcb0d2276f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.690807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e11b606d-34f2-46fb-98e2-9dcb0d2276f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.690987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e11b606d-34f2-46fb-98e2-9dcb0d2276f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.691075] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e11b606d-34f2-46fb-98e2-9dcb0d2276f9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.192078] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b776cc4b-727c-486a-84a0-2fec84d7f56d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.192649] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b776cc4b-727c-486a-84a0-2fec84d7f56d taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.192774] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.195279] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e11b606d-34f2-46fb-98e2-9dcb0d2276f9 with status ACTIVE [ 1196.195279] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.195279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.195279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.195279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.195279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.195279] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.195669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.195669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.195669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.195669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.195821] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.195890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.196275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.196275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.196370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.196410] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e11b606d-34f2-46fb-98e2-9dcb0d2276f9 is going to be updated. [ 1196.235673] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.235944] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.235977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.236245] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.236418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.236598] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e11b606d-34f2-46fb-98e2-9dcb0d2276f9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.480248] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: SUCCESS [ 1196.480483] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.480679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.480902] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.481117] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.481241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.481312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.481493] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.481596] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.481695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.481801] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.695070] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b776cc4b-727c-486a-84a0-2fec84d7f56d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.984470] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.984470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.984470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.984674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.984766] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.984832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.984889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.985061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.985162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.985254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.985402] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.985494] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.985554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.985692] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.985828] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.985918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.985976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.986122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.986200] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.986280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.986367] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.130371] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: SUCCESS [ 1197.130576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.197390] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.197759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.197759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.197829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.197930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.197992] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b776cc4b-727c-486a-84a0-2fec84d7f56d is going to be created. [ 1197.221792] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.221963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.222063] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.222289] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.222447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.233429] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b776cc4b-727c-486a-84a0-2fec84d7f56d in Status: UNINITIALIZED for 2s [ 1197.305058] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2b93818-38bc-46b2-af63-51d39fce766c in Status: SUCCESS [ 1197.305196] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2b93818-38bc-46b2-af63-51d39fce766c deletion is rescheduled due to dependency. [ 1197.305297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b93818-38bc-46b2-af63-51d39fce766c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.439966] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 in Status: SUCCESS [ 1197.439966] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.489029] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e09f4b16-4225-4fb9-9fc8-6dca20ac4d41: rpc.has_security_group_logging(os_id): False [ 1197.507167] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.507359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.507456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.507722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.507843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.508161] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.508302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.508391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.508592] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.508695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.508924] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.509075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.509164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.509352] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.509453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.509687] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.509812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.509900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.510097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.510196] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.510315] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 is going to be created. [ 1197.564671] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.564886] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.564886] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.565131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.565363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.575468] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: IN_PROGRESS for 2s [ 1199.243376] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b776cc4b-727c-486a-84a0-2fec84d7f56d in Status: SUCCESS [ 1199.243757] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.243757] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.244046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.244163] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.244282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.244346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.244503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.244586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.244671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.244817] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b776cc4b-727c-486a-84a0-2fec84d7f56d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.591179] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: SUCCESS [ 1199.591431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.746575] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b776cc4b-727c-486a-84a0-2fec84d7f56d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.250092] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b776cc4b-727c-486a-84a0-2fec84d7f56d: rpc.has_security_group_logging(os_id): False [ 1200.266401] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.269019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.269019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.269019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.269019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.269019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.269019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.269019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.269019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.269019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.269019] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b776cc4b-727c-486a-84a0-2fec84d7f56d is going to be created. [ 1200.326125] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.326811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.327133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.327946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.328373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.353786] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b776cc4b-727c-486a-84a0-2fec84d7f56d in Status: IN_PROGRESS for 2s [ 1200.679788] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1200.680046] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1202.367110] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b776cc4b-727c-486a-84a0-2fec84d7f56d in Status: SUCCESS [ 1202.367512] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.681015] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1205.681370] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1205.687767] env[69499]: INFO networking_nsxv3.common.synchronization [req-55c709d1-a69c-47b0-b70d-a7814244fcba req-e1ca5e70-aba9-4207-a7bf-b725c458b4c2 tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_members [ 1205.688396] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_members [ 1205.688719] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-22e872cc-d333-48f4-bf51-8df73b1a70e3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.688847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.688916] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.689897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.689897] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.689897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.689897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.689897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.689897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.689897] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.074877] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.074877] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.075104] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.075281] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.075549] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.075715] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.075836] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.076071] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.076228] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.076445] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1206.076563] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1206.076728] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1206.076786] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1206.076900] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1206.077015] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1206.077153] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1206.098025] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1206.098396] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1206.098548] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1206.098749] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.099091] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-a93f7f7b-fef2-4761-84c3-cd936b840ecd taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.099282] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-a93f7f7b-fef2-4761-84c3-cd936b840ecd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.099403] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-a93f7f7b-fef2-4761-84c3-cd936b840ecd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.099802] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-a93f7f7b-fef2-4761-84c3-cd936b840ecd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.099953] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a93f7f7b-fef2-4761-84c3-cd936b840ecd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.193757] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.602711] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.602957] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.603144] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.603435] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.603593] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.603752] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port a93f7f7b-fef2-4761-84c3-cd936b840ecd not found, creating... [ 1206.604015] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.604184] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.604336] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.604536] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.604676] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.604959] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.605148] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.605271] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.605482] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.605622] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.605765] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: a93f7f7b-fef2-4761-84c3-cd936b840ecd is going to be created. [ 1206.631712] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.631926] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.632130] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.632392] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.632621] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.632845] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-a93f7f7b-fef2-4761-84c3-cd936b840ecd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.696401] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.198694] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.198869] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.198923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.199192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.199290] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.199395] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 is going to be updated. [ 1207.224818] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.225044] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.225044] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.225248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.225393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.233235] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 in Status: IN_PROGRESS for 2s [ 1207.312522] env[69499]: INFO networking_nsxv3.common.synchronization [req-55c709d1-a69c-47b0-b70d-a7814244fcba req-d22fa662-f902-44c9-bcc3-d74f601b2e7a service nova] Enqueued Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_rules [ 1207.312581] env[69499]: INFO networking_nsxv3.common.synchronization [req-55c709d1-a69c-47b0-b70d-a7814244fcba req-d22fa662-f902-44c9-bcc3-d74f601b2e7a service nova] Enqueued Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_members [ 1207.312717] env[69499]: INFO networking_nsxv3.common.synchronization [req-55c709d1-a69c-47b0-b70d-a7814244fcba req-d22fa662-f902-44c9-bcc3-d74f601b2e7a service nova] Enqueued Resource ID: a93f7f7b-fef2-4761-84c3-cd936b840ecd with Priority: HIGHEST for action port [ 1207.312953] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_rules [ 1207.313171] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_members [ 1207.313269] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a93f7f7b-fef2-4761-84c3-cd936b840ecd with Priority: HIGHEST for action port [ 1207.313826] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22e872cc-d333-48f4-bf51-8df73b1a70e3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.313956] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.314039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.314231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.314312] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.315608] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-22e872cc-d333-48f4-bf51-8df73b1a70e3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.315608] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.315782] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-a93f7f7b-fef2-4761-84c3-cd936b840ecd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.315906] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a93f7f7b-fef2-4761-84c3-cd936b840ecd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.315947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a93f7f7b-fef2-4761-84c3-cd936b840ecd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.316123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a93f7f7b-fef2-4761-84c3-cd936b840ecd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.316197] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a93f7f7b-fef2-4761-84c3-cd936b840ecd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.817855] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-22e872cc-d333-48f4-bf51-8df73b1a70e3 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.818206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.818206] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a93f7f7b-fef2-4761-84c3-cd936b840ecd with status ACTIVE [ 1207.818422] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.818523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.818523] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.818709] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.818802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.818975] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.819085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.819143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.819297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.819378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.819557] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.819654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.819742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.819841] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.819915] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.819999] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a93f7f7b-fef2-4761-84c3-cd936b840ecd is going to be updated. [ 1207.839627] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.839826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.839826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.840051] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.840126] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.840246] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a93f7f7b-fef2-4761-84c3-cd936b840ecd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.904575] env[69499]: INFO networking_nsxv3.common.synchronization [req-07c3f8fc-83a1-4145-81ba-f2b214f0aec1 req-f9cd2f08-967f-48b0-8b35-978868313366 tempest-ServersNegativeTestJSON-1527094857 tempest-ServersNegativeTestJSON-1527094857-project-member] Enqueued Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_members [ 1207.905279] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_members [ 1207.905913] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.907125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.907125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.907125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.907125] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.907125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.907125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.907125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.907125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.907432] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.411556] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.585122] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-365 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.585964] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-365" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.585964] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-365" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.588472] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-365" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.588472] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.588472] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.588472] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.588472] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.588472] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.588472] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1208.588472] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1208.588472] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1208.588472] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1208.588472] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1208.588472] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1208.588956] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1208.606978] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1208.607176] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1208.607347] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1208.607527] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-365" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.607844] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-eed899ae-f579-4d6b-8aff-6cc7c2446030 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.608028] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-eed899ae-f579-4d6b-8aff-6cc7c2446030" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.608161] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-eed899ae-f579-4d6b-8aff-6cc7c2446030" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.608509] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-eed899ae-f579-4d6b-8aff-6cc7c2446030" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.608639] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eed899ae-f579-4d6b-8aff-6cc7c2446030',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.912845] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.111474] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.111708] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.111844] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.112209] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.112375] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.112535] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port eed899ae-f579-4d6b-8aff-6cc7c2446030 not found, creating... [ 1209.112794] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.112968] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.113220] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.113381] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.113529] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.113817] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.113975] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.114109] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.114325] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.114472] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.114620] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: eed899ae-f579-4d6b-8aff-6cc7c2446030 is going to be created. [ 1209.132064] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.132299] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.132431] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.132683] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.132911] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.133193] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-eed899ae-f579-4d6b-8aff-6cc7c2446030" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.244826] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 in Status: SUCCESS [ 1209.244826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.244826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.244826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.244826] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.244826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.244826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.244826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.244826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.244826] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.415275] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.415466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.415648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.415990] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.416282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.416360] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 is going to be updated. [ 1209.443375] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.443643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.443643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.443928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.444153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.452708] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: IN_PROGRESS for 2s [ 1209.746815] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.835925] env[69499]: INFO networking_nsxv3.common.synchronization [req-07c3f8fc-83a1-4145-81ba-f2b214f0aec1 req-3ebf8776-07de-47e5-80df-ae84ff034a12 service nova] Enqueued Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_rules [ 1209.836180] env[69499]: INFO networking_nsxv3.common.synchronization [req-07c3f8fc-83a1-4145-81ba-f2b214f0aec1 req-3ebf8776-07de-47e5-80df-ae84ff034a12 service nova] Enqueued Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_members [ 1209.836367] env[69499]: INFO networking_nsxv3.common.synchronization [req-07c3f8fc-83a1-4145-81ba-f2b214f0aec1 req-3ebf8776-07de-47e5-80df-ae84ff034a12 service nova] Enqueued Resource ID: eed899ae-f579-4d6b-8aff-6cc7c2446030 with Priority: HIGHEST for action port [ 1209.836934] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_rules [ 1209.837427] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_members [ 1209.837597] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed899ae-f579-4d6b-8aff-6cc7c2446030 with Priority: HIGHEST for action port [ 1209.838187] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.838187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.838187] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.838475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.838610] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.839691] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.839852] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.840119] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-eed899ae-f579-4d6b-8aff-6cc7c2446030 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.840284] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eed899ae-f579-4d6b-8aff-6cc7c2446030" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.840387] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eed899ae-f579-4d6b-8aff-6cc7c2446030" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.840609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eed899ae-f579-4d6b-8aff-6cc7c2446030" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.840750] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eed899ae-f579-4d6b-8aff-6cc7c2446030',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.250605] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.343415] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.343561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.343805] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eed899ae-f579-4d6b-8aff-6cc7c2446030 with status ACTIVE [ 1210.344037] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.344162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.344230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.344450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.344539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.344712] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.344806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.344863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.345024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.345120] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.345353] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.345454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.345553] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.345741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.345833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.345928] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eed899ae-f579-4d6b-8aff-6cc7c2446030 is going to be updated. [ 1210.369495] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.369495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.369495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.369495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.369495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.369495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eed899ae-f579-4d6b-8aff-6cc7c2446030" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.753615] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.753829] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.753923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.754233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.754398] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.754555] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 is going to be updated. [ 1210.783350] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.783481] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.783598] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.783910] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.784152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.792879] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 in Status: IN_PROGRESS for 2s [ 1211.463466] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: SUCCESS [ 1211.463466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.463753] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.463872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.464210] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.464210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.464409] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.464566] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.464781] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.464781] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.967465] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.469170] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.801966] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 in Status: SUCCESS [ 1212.802270] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.802461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.802685] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.802883] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.803043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.803118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.803234] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.803319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.803425] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.803531] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.971175] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.971419] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.971419] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.971618] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.971712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.971924] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 is going to be updated. [ 1212.999963] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.000184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.000286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.000412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.000579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.009260] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: IN_PROGRESS for 2s [ 1213.305962] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.808111] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22e872cc-d333-48f4-bf51-8df73b1a70e3: rpc.has_security_group_logging(os_id): False [ 1213.829444] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.829642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.829713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.830315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.830315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.830466] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.830568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.830568] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.830701] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.830777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.830866] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 is going to be updated. [ 1213.886221] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.886457] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.886509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.886698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.886843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.908655] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 in Status: IN_PROGRESS for 2s [ 1214.838838] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1214.839087] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1215.018788] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: SUCCESS [ 1215.018943] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.019098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.019318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.019506] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.019623] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.019688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.019865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.019900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.020154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.020154] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.522934] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.523127] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.523235] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.523426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.523589] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.523682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.523758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.523891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.523978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.524078] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.524224] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.524316] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.524376] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.524524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.524652] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.524739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.524807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.524934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.525016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.525113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.525203] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.930400] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 in Status: SUCCESS [ 1215.930840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.027439] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e09f4b16-4225-4fb9-9fc8-6dca20ac4d41: rpc.has_security_group_logging(os_id): False [ 1216.046202] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.046350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.046416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.046637] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.046730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.046961] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.047077] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.047130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.047274] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.047350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.047527] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.047641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.047721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.047849] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.047932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.048119] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.048210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.048257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.048405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.048475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.048547] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 is going to be updated. [ 1216.109029] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.109202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.109202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.109390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.109710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.127305] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: IN_PROGRESS for 2s [ 1217.592534] env[69499]: INFO networking_nsxv3.common.synchronization [None req-cbd4f115-7aad-4039-a0ba-61367bc0b53c tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1217.593425] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1217.593979] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.593979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.594136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.594719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.594719] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.594895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.594992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.595264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.595413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.595576] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.984806] env[69499]: INFO networking_nsxv3.common.synchronization [req-51f3cc74-b629-440e-bd22-486f66317283 req-3cfd47ea-15a9-41c3-b24f-89a79fcb3208 tempest-ServerRescueTestJSON-863883418 tempest-ServerRescueTestJSON-863883418-project-member] Enqueued Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_members [ 1217.985327] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_members [ 1217.985643] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.985763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.985830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.987134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.987491] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.987648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.987742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.987948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.988076] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.988198] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.103528] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.103937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.104083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.104399] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.104632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.104861] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.105295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.105295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.105295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.105404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.105404] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1218.130667] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.130805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.130871] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.131085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.131236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.140052] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1218.141050] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: SUCCESS [ 1218.141263] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.490798] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.992622] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.495349] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.496073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.496073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.496073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.496073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.496300] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 is going to be updated. [ 1219.522727] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.522860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.524362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.524362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.524362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.532248] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: IN_PROGRESS for 2s [ 1219.890045] env[69499]: INFO networking_nsxv3.common.synchronization [req-7fed55a9-1f55-4de3-9cae-0a4653d49eeb req-90ab5db5-d1c9-4a8c-be47-d07b84c8d355 tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_members [ 1219.892134] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_members [ 1219.892134] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.892134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.892134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.892134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.892134] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.892134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.892134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.892134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.892134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.892564] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.900174] env[69499]: INFO networking_nsxv3.common.synchronization [req-c6696eef-ec56-4dfc-8fb0-c14f189d3b56 req-d57281a2-6c29-4192-9367-6f184fb25acc tempest-ServersNegativeTestJSON-1527094857 tempest-ServersNegativeTestJSON-1527094857-project-member] Enqueued Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_members [ 1219.900597] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_members [ 1219.900886] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.901009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.901084] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.901260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.901407] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.901502] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.901564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.901707] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.901791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.901884] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.153062] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1220.153315] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 deletion is rescheduled due to dependency. [ 1220.153315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.259128] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.259349] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.259488] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.259764] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.260038] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.263567] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.263567] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.263567] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.263567] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.263567] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1220.263567] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1220.263567] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1220.263567] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1220.263567] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1220.263567] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1220.263567] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1220.283579] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1220.283579] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1220.283579] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1220.283579] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-899" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.283579] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-888e9cea-1939-4574-9945-9bc451a7538a taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.283579] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-888e9cea-1939-4574-9945-9bc451a7538a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.283579] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-888e9cea-1939-4574-9945-9bc451a7538a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.284210] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-888e9cea-1939-4574-9945-9bc451a7538a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.284210] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('888e9cea-1939-4574-9945-9bc451a7538a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.401281] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.405491] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.785896] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.786139] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.786274] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.786575] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.786733] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.786891] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 888e9cea-1939-4574-9945-9bc451a7538a not found, creating... [ 1220.787168] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.787328] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.787448] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.787704] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.787853] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.788152] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.788311] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.788432] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.788640] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.788788] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.788948] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 888e9cea-1939-4574-9945-9bc451a7538a is going to be created. [ 1220.807421] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.807711] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.807869] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.808125] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.808493] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.808610] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-888e9cea-1939-4574-9945-9bc451a7538a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.907713] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.908693] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.410293] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.410675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.410675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.410791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.410839] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.411027] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd is going to be updated. [ 1221.413828] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.414044] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.414044] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.414181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.414267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.414361] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 is going to be updated. [ 1221.441180] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.441406] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.441477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.441663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.441815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.443576] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.443710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.443788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.443921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.444178] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.453322] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd in Status: IN_PROGRESS for 2s [ 1221.453908] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: IN_PROGRESS for 2s [ 1221.540537] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: SUCCESS [ 1221.540753] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.679730] env[69499]: INFO networking_nsxv3.common.synchronization [req-7fed55a9-1f55-4de3-9cae-0a4653d49eeb req-51aace70-0a3d-4c7f-afe7-7a2be8b731db service nova] Enqueued Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_rules [ 1221.679922] env[69499]: INFO networking_nsxv3.common.synchronization [req-7fed55a9-1f55-4de3-9cae-0a4653d49eeb req-51aace70-0a3d-4c7f-afe7-7a2be8b731db service nova] Enqueued Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_members [ 1221.680168] env[69499]: INFO networking_nsxv3.common.synchronization [req-7fed55a9-1f55-4de3-9cae-0a4653d49eeb req-51aace70-0a3d-4c7f-afe7-7a2be8b731db service nova] Enqueued Resource ID: 888e9cea-1939-4574-9945-9bc451a7538a with Priority: HIGHEST for action port [ 1221.680477] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_rules [ 1221.680636] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_members [ 1221.680749] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 888e9cea-1939-4574-9945-9bc451a7538a with Priority: HIGHEST for action port [ 1221.682448] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.682448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.682448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.682448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.682448] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.683120] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.683330] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.683539] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-888e9cea-1939-4574-9945-9bc451a7538a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.683673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-888e9cea-1939-4574-9945-9bc451a7538a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.683712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-888e9cea-1939-4574-9945-9bc451a7538a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.683867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-888e9cea-1939-4574-9945-9bc451a7538a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.683929] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('888e9cea-1939-4574-9945-9bc451a7538a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.185646] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.185851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.186091] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 888e9cea-1939-4574-9945-9bc451a7538a with status ACTIVE [ 1222.186091] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.186392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.186392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.186480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.186570] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.186739] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.186835] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.186895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.187060] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.187137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.187358] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.187461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.187515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.187661] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.187732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.187816] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 888e9cea-1939-4574-9945-9bc451a7538a is going to be updated. [ 1222.243021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.243244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.243396] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.243561] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.243696] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.243851] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-888e9cea-1939-4574-9945-9bc451a7538a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.467055] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: SUCCESS [ 1223.467370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.467998] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd in Status: SUCCESS [ 1223.468169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.468275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.468503] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.468682] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.468811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.468966] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.469107] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.469162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.469232] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.972622] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.474794] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.587828] env[69499]: INFO networking_nsxv3.common.synchronization [req-1a5fc323-9d18-4023-a174-26527119019e req-66f723a6-72f7-4f33-8c54-e474a6b8219d tempest-ServerRescueTestJSON-863883418 tempest-ServerRescueTestJSON-863883418-project-member] Enqueued Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_members [ 1224.587828] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGHEST for action security_group_members [ 1224.587828] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.587973] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.588089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.588328] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.588514] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.589736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.589736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.589736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.589736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.589736] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.981794] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.981951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.982043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.982328] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.982421] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.982524] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd is going to be updated. [ 1225.009051] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.009221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.009294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.009556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.009718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.017432] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd in Status: IN_PROGRESS for 2s [ 1225.092065] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.092237] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.092331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.092557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.092670] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.092906] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.093057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.093099] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.093254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.093379] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.093495] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 is going to be updated. [ 1225.120425] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.120425] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.120585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.120814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.120814] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.129116] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: IN_PROGRESS for 2s [ 1227.026418] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd in Status: SUCCESS [ 1227.026743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.026782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.027011] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.027209] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.027331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.027395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.027548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.027711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.027809] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.027899] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.140295] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: IN_PROGRESS for 4s [ 1227.531175] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.034622] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35e560ef-ae12-4b78-9fd4-fb9be25e66dd: rpc.has_security_group_logging(os_id): False [ 1228.054917] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.054917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.054917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.054917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.073025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.073025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.073025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.073025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.073025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.073025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.073025] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd is going to be updated. [ 1228.134336] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.134336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.134336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.134336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.134336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.146774] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd in Status: IN_PROGRESS for 2s [ 1229.151818] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 in Status: SUCCESS [ 1229.152153] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 deletion is rescheduled due to dependency. [ 1229.152153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.588288] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1229.588403] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1230.159373] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd in Status: SUCCESS [ 1230.159373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.365416] env[69499]: INFO networking_nsxv3.common.synchronization [req-fc9e35e5-5443-4327-b604-8e90e163c07b req-65d837d2-62f3-4677-b8d2-f19026f96173 tempest-ServerActionsTestJSON-629709431 tempest-ServerActionsTestJSON-629709431-project-member] Enqueued Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 1230.367021] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 with Priority: HIGHEST for action security_group_members [ 1230.368129] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.368129] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.368129] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.368129] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.368129] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.368342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.368342] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.368404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.368436] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.368582] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fc2518-1857-49ca-8dcd-c34aaa8c5c22',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.870580] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.870739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.870811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.871049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.871700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.871700] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.871700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.871700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.871700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.871700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.871989] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 is going to be updated. [ 1230.915914] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.916057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.916057] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.916236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.916445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.939089] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: IN_PROGRESS for 2s [ 1232.949283] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 in Status: SUCCESS [ 1232.949598] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fc2518-1857-49ca-8dcd-c34aaa8c5c22 deletion is rescheduled due to dependency. [ 1232.949598] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fc2518-1857-49ca-8dcd-c34aaa8c5c22" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.368471] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1235.368777] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1236.813651] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.813651] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.813651] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.814048] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.814164] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.814344] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.814468] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.814718] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.814866] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.815094] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1236.815216] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1236.815330] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1236.815443] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1236.815617] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1236.815672] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1236.815800] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1236.835392] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1236.835804] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1236.835804] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1236.836118] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.836261] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-d9dd0159-6414-409f-8614-49890e5a4c1c taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.836478] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.836659] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.836949] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.837119] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9dd0159-6414-409f-8614-49890e5a4c1c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.339772] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.339984] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.340130] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.340424] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.340584] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.340740] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port d9dd0159-6414-409f-8614-49890e5a4c1c not found, creating... [ 1237.340997] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.341166] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.341288] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.341512] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.341657] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.341938] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.342108] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.342230] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.342447] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.342583] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.342725] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: d9dd0159-6414-409f-8614-49890e5a4c1c is going to be created. [ 1237.363637] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.363805] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.363936] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.364194] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.364419] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.364635] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.040070] env[69499]: INFO networking_nsxv3.common.synchronization [req-f7069649-4d32-47f5-9dfb-49351b9a96d3 req-56b93748-1956-45de-8664-f4b3dcf8f8c3 service nova] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_rules [ 1238.040438] env[69499]: INFO networking_nsxv3.common.synchronization [req-f7069649-4d32-47f5-9dfb-49351b9a96d3 req-56b93748-1956-45de-8664-f4b3dcf8f8c3 service nova] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1238.040438] env[69499]: INFO networking_nsxv3.common.synchronization [req-f7069649-4d32-47f5-9dfb-49351b9a96d3 req-56b93748-1956-45de-8664-f4b3dcf8f8c3 service nova] Enqueued Resource ID: d9dd0159-6414-409f-8614-49890e5a4c1c with Priority: HIGHEST for action port [ 1238.041885] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_rules [ 1238.041885] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1238.041885] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9dd0159-6414-409f-8614-49890e5a4c1c with Priority: HIGHEST for action port [ 1238.041885] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.041885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.041885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.041885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.041885] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.045687] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.045897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.045897] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.046108] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.046228] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.046301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.046362] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.046504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.046579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.046636] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.047700] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9dd0159-6414-409f-8614-49890e5a4c1c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.047858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.047930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.049595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.049595] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9dd0159-6414-409f-8614-49890e5a4c1c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.546350] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.546509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.549977] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.551054] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9dd0159-6414-409f-8614-49890e5a4c1c with status ACTIVE [ 1238.551298] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.551447] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.551505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.551857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.551857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.552066] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.552269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.552269] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.553030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.553030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.553030] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.553030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.553030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.553286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.553286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.553286] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9dd0159-6414-409f-8614-49890e5a4c1c is going to be updated. [ 1238.572616] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.572759] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.572825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.573033] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.573205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.573315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.055148] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.557536] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.557805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.557805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.557979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.558085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.558186] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1239.586022] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.586220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.586220] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.586377] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.586582] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.594311] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1241.605445] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1241.605820] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.605820] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.606039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.606233] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.606368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.606432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.606692] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.606786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.606880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.606969] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.109570] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.109712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.109917] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.110221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.110435] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.110562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.110640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.110807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.110909] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.111010] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.111188] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.111279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.111340] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.111498] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.111641] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.112043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.112222] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.112580] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.112700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.112801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.112896] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.616584] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4968c8b1-e03b-4720-ad0c-9445bc9427b6: rpc.has_security_group_logging(os_id): False [ 1242.632283] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.632283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.632283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.632608] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.632680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.633020] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.633020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.633232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.633232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.633291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.633786] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.633786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.633786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.633786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.633982] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.633982] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.634333] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.634333] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.634333] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.634333] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.634493] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1242.694163] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.694350] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.694399] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.694600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.694747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.708443] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1243.042160] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1243.042329] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1244.724021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1244.724292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.043395] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1248.043768] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1252.850931] env[69499]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1252.851223] env[69499]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1253.044468] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1253.044592] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1254.096514] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.096830] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.096924] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.097264] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.097571] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.097758] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.097926] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.098367] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.098566] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.098812] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1254.098939] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1254.099066] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1254.099185] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1254.099342] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1254.099485] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1254.099660] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1254.118166] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1254.118362] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1254.118542] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1254.118775] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-876" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.119140] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-d9dd0159-6414-409f-8614-49890e5a4c1c taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.119358] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.119531] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.119954] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.120138] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9dd0159-6414-409f-8614-49890e5a4c1c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.623518] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.623784] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.623954] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.624260] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.624420] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.624709] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.624874] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.625015] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.625240] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.625381] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.625662] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.625823] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.625944] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.626172] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.626311] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.626456] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: d9dd0159-6414-409f-8614-49890e5a4c1c is going to be updated. [ 1254.646519] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.646519] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.646519] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.646739] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.647365] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.647365] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.335234] env[69499]: INFO networking_nsxv3.common.synchronization [req-eae6ee46-ccf5-42c6-8221-e74f170c6b22 req-dbcef07c-2c0c-45b3-bfb7-b641868c1a40 service nova] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_rules [ 1255.335528] env[69499]: INFO networking_nsxv3.common.synchronization [req-eae6ee46-ccf5-42c6-8221-e74f170c6b22 req-dbcef07c-2c0c-45b3-bfb7-b641868c1a40 service nova] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1255.335528] env[69499]: INFO networking_nsxv3.common.synchronization [req-eae6ee46-ccf5-42c6-8221-e74f170c6b22 req-dbcef07c-2c0c-45b3-bfb7-b641868c1a40 service nova] Enqueued Resource ID: d9dd0159-6414-409f-8614-49890e5a4c1c with Priority: HIGHEST for action port [ 1255.335728] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_rules [ 1255.335861] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1255.335968] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9dd0159-6414-409f-8614-49890e5a4c1c with Priority: HIGHEST for action port [ 1255.336516] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.336643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.336713] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.336909] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.336990] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.338745] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.338881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.338929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.339176] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.339406] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.339564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.339666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.339903] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.340062] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.340207] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.341986] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9dd0159-6414-409f-8614-49890e5a4c1c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.342168] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.342275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.342522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.342687] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9dd0159-6414-409f-8614-49890e5a4c1c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.844663] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.845813] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.845937] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.846483] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9dd0159-6414-409f-8614-49890e5a4c1c with status ACTIVE [ 1255.846483] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.846634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.846634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.846837] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.846924] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.847103] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.847199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.847255] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.847408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.847485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.847661] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.847755] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.847816] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.848288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.848288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.848288] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9dd0159-6414-409f-8614-49890e5a4c1c is going to be updated. [ 1255.869985] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.870165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.870165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.870353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.870477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.870626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9dd0159-6414-409f-8614-49890e5a4c1c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.347578] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.849854] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.850035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.850097] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.850264] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.850355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.850449] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1256.885143] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.885349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.885459] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.885733] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.885928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.894372] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1257.763208] env[69499]: INFO networking_nsxv3.common.synchronization [req-1255e954-97fd-48f9-91ac-d60532d7143e req-ee35804a-711a-4e51-85ae-7b9fcd1c8420 tempest-AttachVolumeNegativeTest-328272220 tempest-AttachVolumeNegativeTest-328272220-project-member] Enqueued Resource ID: b776cc4b-727c-486a-84a0-2fec84d7f56d with Priority: HIGHEST for action security_group_members [ 1257.763780] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b776cc4b-727c-486a-84a0-2fec84d7f56d with Priority: HIGHEST for action security_group_members [ 1257.764097] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-b776cc4b-727c-486a-84a0-2fec84d7f56d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.764225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.764292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.764505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.764669] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.764772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.764841] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.765027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.765146] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.765249] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b776cc4b-727c-486a-84a0-2fec84d7f56d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.271272] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.271617] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.271617] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.271756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.271877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.272117] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.272239] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.272288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.272444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.272524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.272620] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b776cc4b-727c-486a-84a0-2fec84d7f56d is going to be updated. [ 1258.297111] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.297277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.297324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.297486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.297633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.306696] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b776cc4b-727c-486a-84a0-2fec84d7f56d in Status: IN_PROGRESS for 2s [ 1258.904512] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1258.904807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.904885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.905123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.905311] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.905429] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.905494] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.905642] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.905723] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.905806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.905895] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.408197] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.408289] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.408330] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.408643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.408886] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.409043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.409123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.409310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.409410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.409517] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.409670] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.409788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.409857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.410030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.410189] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.410284] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.410356] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.410510] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.410616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.410720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.410819] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.913150] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4968c8b1-e03b-4720-ad0c-9445bc9427b6: rpc.has_security_group_logging(os_id): False [ 1259.930985] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.930985] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.930985] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.931217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.931217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.931399] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.931536] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.931577] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.931725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.931806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.931981] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.932098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.932193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.932366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.932445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.932624] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.932770] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.932833] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.932933] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.933016] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.933107] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1259.989204] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.989359] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.989402] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.989616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.989756] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.003961] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1260.315617] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b776cc4b-727c-486a-84a0-2fec84d7f56d in Status: SUCCESS [ 1260.315919] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b776cc4b-727c-486a-84a0-2fec84d7f56d deletion is rescheduled due to dependency. [ 1260.316110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.017858] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1262.017858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.765184] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.765360] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1266.616093] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-365 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.616424] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-365" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.616424] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-365" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.616639] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-365" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.616897] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.617067] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.617196] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.617426] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.617576] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.617783] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1266.617900] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1266.618021] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1266.618135] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1266.618249] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1266.618358] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1266.618495] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1266.641522] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1266.641711] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1266.641821] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1266.642017] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-365" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.642288] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.642453] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.642595] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.642824] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.642973] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d05833cf-adbb-4f7c-a9f7-c544d6fae9d8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.145604] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.145856] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.145990] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.146288] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.146677] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.146778] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.146888] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.146992] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.147232] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.147376] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.147655] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.147820] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.147920] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.148145] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.148283] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.148431] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 is going to be updated. [ 1267.167781] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.167993] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.168127] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.168379] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.168571] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.168786] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.766016] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1267.766311] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1267.883408] env[69499]: INFO networking_nsxv3.common.synchronization [req-ec595e2f-fdc3-4327-b82d-6330b12c6638 req-1cb55752-7dc6-4fe9-abac-594020a6f8ea service nova] Enqueued Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_rules [ 1267.883586] env[69499]: INFO networking_nsxv3.common.synchronization [req-ec595e2f-fdc3-4327-b82d-6330b12c6638 req-1cb55752-7dc6-4fe9-abac-594020a6f8ea service nova] Enqueued Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_members [ 1267.883768] env[69499]: INFO networking_nsxv3.common.synchronization [req-ec595e2f-fdc3-4327-b82d-6330b12c6638 req-1cb55752-7dc6-4fe9-abac-594020a6f8ea service nova] Enqueued Resource ID: d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 with Priority: HIGHEST for action port [ 1267.884326] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_rules [ 1267.884459] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_members [ 1267.884552] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 with Priority: HIGHEST for action port [ 1267.884817] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.884941] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.885011] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.885215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.885294] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.886101] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.886213] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.886283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.886441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.886580] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.886675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.886775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.886886] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.886963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.887008] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.889117] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.889227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.889227] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.889382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.889453] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d05833cf-adbb-4f7c-a9f7-c544d6fae9d8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.390929] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.391143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.391311] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.392250] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 with status ACTIVE [ 1268.392441] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.392560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.392627] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.392855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.392949] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.393159] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.393260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.393329] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.393476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.393560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.393732] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.393842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.393905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.394068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.394143] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.394274] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d05833cf-adbb-4f7c-a9f7-c544d6fae9d8 is going to be updated. [ 1268.414814] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.415035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.415035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.415236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.415371] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.415518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d05833cf-adbb-4f7c-a9f7-c544d6fae9d8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.896189] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.398596] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.398766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.398864] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.399070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.399169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.399272] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 is going to be updated. [ 1269.430795] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.430996] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.431102] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.431366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.431562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.441572] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: IN_PROGRESS for 2s [ 1269.884519] env[69499]: INFO networking_nsxv3.common.synchronization [req-397eda30-3339-4bb9-95f9-ff516c6bcc4e req-eda85861-9eea-4a6f-ba4a-c3d2d8cc8799 tempest-ServerActionsTestOtherB-1591609705 tempest-ServerActionsTestOtherB-1591609705-project-member] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1269.884706] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1269.885054] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.885198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.885267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.885467] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.885620] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.885718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.885781] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.885927] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.886021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.886115] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.389034] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.389427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.389427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.389531] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.389531] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.389726] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.389834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.389899] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.390058] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.390135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.390224] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be updated. [ 1270.414604] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.414881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.414881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.415035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.415150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.424326] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 2s [ 1271.082973] env[69499]: INFO networking_nsxv3.common.synchronization [req-0643d2b6-91d5-4b45-992a-88c52f68a0d4 req-fb6cb954-bcfe-4044-84a5-7163a385613f tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_members [ 1271.083564] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_members [ 1271.083899] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-22e872cc-d333-48f4-bf51-8df73b1a70e3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.084035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.084098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.084319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.084474] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.084639] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.084639] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.084778] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.084866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.084940] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.452357] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: SUCCESS [ 1271.452357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.452357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.452357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.452357] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.452357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.452357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.452357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.452357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.452357] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.452357] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.589917] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.954162] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.954328] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.954379] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.954595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.954760] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.954861] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.954927] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.955089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.955195] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.955291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.955585] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.955585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.955585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.955703] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.955841] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.955930] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.955984] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.956135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.956203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.956284] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.956399] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.093668] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.434590] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1272.434794] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b deletion is rescheduled due to dependency. [ 1272.434918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.458430] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e09f4b16-4225-4fb9-9fc8-6dca20ac4d41: rpc.has_security_group_logging(os_id): False [ 1272.475432] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.475589] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.475635] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.475860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.475953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.476204] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.476307] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.476373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.476527] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.476604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.476807] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.476922] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.476987] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.477152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.477228] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.477406] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.477500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.477560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.477700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.477773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.477858] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 is going to be updated. [ 1272.533323] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.533532] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.533532] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.533719] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.533953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.547873] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: IN_PROGRESS for 2s [ 1272.596624] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.596815] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.596867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.597112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.597210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.597310] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 is going to be updated. [ 1272.644922] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.645162] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.645267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.645443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.645586] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.655176] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 in Status: IN_PROGRESS for 2s [ 1274.565434] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: SUCCESS [ 1274.565434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.667578] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 in Status: SUCCESS [ 1274.667811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.084852] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1276.085254] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1278.898301] env[69499]: INFO networking_nsxv3.common.synchronization [req-eb629f02-f41b-4ee1-892c-054725fd6934 req-73e33f18-c4ba-4b4a-818f-5c2414b68219 tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_members [ 1278.899042] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 with Priority: HIGHEST for action security_group_members [ 1278.899442] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-22e872cc-d333-48f4-bf51-8df73b1a70e3 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.899599] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.899673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.899893] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.900039] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.900154] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.900223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.900367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.900452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.900544] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22e872cc-d333-48f4-bf51-8df73b1a70e3',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.307765] env[69499]: INFO networking_nsxv3.common.synchronization [req-89c52f6c-b80a-41a8-81d7-4d685372c1a2 req-4403976c-3bb7-4fb3-a29b-2eba22bdd2be tempest-ServerActionsTestOtherB-1591609705 tempest-ServerActionsTestOtherB-1591609705-project-member] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1279.308324] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1279.308679] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.308804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.308873] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.309098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.309249] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.309348] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.309410] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.309562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.309647] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.309738] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.403216] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.403470] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.403554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.403776] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.403989] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.404289] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.404445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.404537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.404754] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.404844] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.405046] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 is going to be updated. [ 1279.433184] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.433332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.433380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.433579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.433866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.441684] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 in Status: IN_PROGRESS for 2s [ 1279.562954] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-728 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.563290] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.563424] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.563699] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.563994] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.564188] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.564311] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.564536] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.564683] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.564906] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1279.565035] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1279.565152] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1279.565279] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1279.565389] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1279.565499] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1279.565643] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1279.584299] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1279.584465] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1279.584664] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1279.584858] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.585166] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.585335] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.585457] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.585743] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.585880] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86e8aa40-bbb0-4477-bafb-c26b9d1fe217',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.811796] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.811951] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.812042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.812273] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.812367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.812575] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.812681] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.812734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.812880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.812986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.813087] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be updated. [ 1279.841091] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.841252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.841294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.841468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.841601] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.850197] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 2s [ 1280.087900] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.088238] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.088280] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.088556] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.088707] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.088871] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 86e8aa40-bbb0-4477-bafb-c26b9d1fe217 not found, creating... [ 1280.089157] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.089320] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.089467] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.089693] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.089846] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.090337] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.090337] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.090474] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.090666] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.090813] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.091050] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 86e8aa40-bbb0-4477-bafb-c26b9d1fe217 is going to be created. [ 1280.109387] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.109578] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.109707] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.109945] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.110189] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.110404] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.785087] env[69499]: INFO networking_nsxv3.common.synchronization [req-89c52f6c-b80a-41a8-81d7-4d685372c1a2 req-5e2aea4c-a439-4ba9-9733-3301a77cd8bc service nova] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_rules [ 1280.785087] env[69499]: INFO networking_nsxv3.common.synchronization [req-89c52f6c-b80a-41a8-81d7-4d685372c1a2 req-5e2aea4c-a439-4ba9-9733-3301a77cd8bc service nova] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1280.785087] env[69499]: INFO networking_nsxv3.common.synchronization [req-89c52f6c-b80a-41a8-81d7-4d685372c1a2 req-5e2aea4c-a439-4ba9-9733-3301a77cd8bc service nova] Enqueued Resource ID: 86e8aa40-bbb0-4477-bafb-c26b9d1fe217 with Priority: HIGHEST for action port [ 1280.785087] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_rules [ 1280.785087] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1280.785087] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86e8aa40-bbb0-4477-bafb-c26b9d1fe217 with Priority: HIGHEST for action port [ 1280.785087] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.785087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.785087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.786020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.786235] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.787630] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.787789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.788625] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.788625] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.788625] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.788625] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.788625] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86e8aa40-bbb0-4477-bafb-c26b9d1fe217',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.290581] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.290850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.290983] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86e8aa40-bbb0-4477-bafb-c26b9d1fe217 with status ACTIVE [ 1281.291185] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.291297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.291364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.291572] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.291662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.291827] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.291921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.291982] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.292141] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.292217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.292394] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.292488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.292550] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.292688] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.292764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.292847] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86e8aa40-bbb0-4477-bafb-c26b9d1fe217 is going to be updated. [ 1281.312516] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.312667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.312711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.312881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.313088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.313247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.451903] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 in Status: SUCCESS [ 1281.452098] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22e872cc-d333-48f4-bf51-8df73b1a70e3 deletion is rescheduled due to dependency. [ 1281.452211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22e872cc-d333-48f4-bf51-8df73b1a70e3" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.859788] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1281.860067] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b deletion is rescheduled due to dependency. [ 1281.860334] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.860573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.860879] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.861189] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.861368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.861500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.861721] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.861860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.862026] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.364355] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.866136] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.903914] env[69499]: INFO networking_nsxv3.common.synchronization [None req-3dc02300-4a91-4ae1-9aaa-56eca69630ed tempest-AttachInterfacesTestJSON-84205195 tempest-AttachInterfacesTestJSON-84205195-project-member] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1282.904250] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGHEST for action security_group_members [ 1282.904562] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.904678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.904753] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.904942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.905104] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.905408] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.905483] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.905635] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.905730] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.905845] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.368465] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.368805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.368805] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.368920] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.369032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.369151] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be updated. [ 1283.396723] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.396918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.396961] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.397181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.397330] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.405966] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 2s [ 1283.408355] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.408488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.408557] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.408757] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.408842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.409033] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.409142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.409198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.409339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.409418] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.409504] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be updated. [ 1283.433561] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.433705] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.433786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.434023] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.434186] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.441792] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: IN_PROGRESS for 2s [ 1285.415683] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1285.416034] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.416136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.416392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.416627] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.416785] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.416853] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.417129] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.417249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.417356] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.417453] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.450541] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 in Status: SUCCESS [ 1285.450873] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 deletion is rescheduled due to dependency. [ 1285.451065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.919913] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.422660] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 717f63b4-82e8-4749-8d24-1abe7790389b: rpc.has_security_group_logging(os_id): False [ 1286.442606] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.442747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.442850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.443179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.443267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.443458] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.443564] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.443629] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.443782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.443859] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.443947] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be updated. [ 1286.509185] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.509326] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.509400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.509617] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.509765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.522227] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 2s [ 1286.881024] env[69499]: INFO networking_nsxv3.common.synchronization [None req-b45b6bed-f54d-40b1-9ce8-c8b16e43df09 None None] Enqueued Resource ID: b3a7f9ea-33ba-4487-9833-63528115dda2 with Priority: HIGHEST for action port [ 1286.881224] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3a7f9ea-33ba-4487-9833-63528115dda2 with Priority: HIGHEST for action port [ 1286.881813] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3a7f9ea-33ba-4487-9833-63528115dda2 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.881939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3a7f9ea-33ba-4487-9833-63528115dda2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.882063] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3a7f9ea-33ba-4487-9833-63528115dda2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.882280] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3a7f9ea-33ba-4487-9833-63528115dda2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.882355] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3a7f9ea-33ba-4487-9833-63528115dda2',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.384498] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3a7f9ea-33ba-4487-9833-63528115dda2 [ 1287.384723] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.384863] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.384935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.385155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.385238] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.385336] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3a7f9ea-33ba-4487-9833-63528115dda2 already deleted. [ 1287.385475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3a7f9ea-33ba-4487-9833-63528115dda2" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.535995] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1288.536406] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.200845] env[69499]: INFO networking_nsxv3.common.synchronization [None req-36c365bc-fa3b-4b50-ab11-bf7f8ce46b51 None None] Enqueued Resource ID: 37780af3-66af-4689-9b34-2c552a264965 with Priority: HIGHEST for action port [ 1289.201802] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37780af3-66af-4689-9b34-2c552a264965 with Priority: HIGHEST for action port [ 1289.202107] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-37780af3-66af-4689-9b34-2c552a264965 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.202236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37780af3-66af-4689-9b34-2c552a264965" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.202302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37780af3-66af-4689-9b34-2c552a264965" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.202766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37780af3-66af-4689-9b34-2c552a264965" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.202766] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37780af3-66af-4689-9b34-2c552a264965',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.707802] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37780af3-66af-4689-9b34-2c552a264965 [ 1289.708156] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.708156] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.708156] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.708383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.708441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.708533] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37780af3-66af-4689-9b34-2c552a264965 already deleted. [ 1289.708609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37780af3-66af-4689-9b34-2c552a264965" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.542472] env[69499]: INFO networking_nsxv3.common.synchronization [req-dfeba6e2-4b56-4800-81fc-d0665189a77b req-34e5e4dc-0e91-4b08-93d2-7c0a1b57fa9a tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_members [ 1290.543276] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_members [ 1290.543720] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.543901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.544010] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.544324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.544532] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.544660] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.544728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.544890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.544970] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.545071] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.046955] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.550062] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.052710] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.053025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.053025] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.053318] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.053584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.053692] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd is going to be updated. [ 1292.080498] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.080702] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.080769] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.080980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.081163] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.088882] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd in Status: IN_PROGRESS for 2s [ 1292.418528] env[69499]: INFO networking_nsxv3.common.synchronization [req-5e228067-547e-4b10-9af7-55ced8eb5495 req-f87df87e-f14a-4208-90b0-9437c7f5707d tempest-DeleteServersTestJSON-831065566 tempest-DeleteServersTestJSON-831065566-project-member] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1292.418904] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1292.419319] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.419462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.419596] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.419928] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.420278] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.420389] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.420441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.420854] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.420854] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.420854] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.673744] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.673952] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.674095] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.674486] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.674761] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.674926] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.675060] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.675393] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.675587] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.675811] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1292.675931] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1292.676073] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1292.676194] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1292.676312] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1292.676425] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1292.676886] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1292.693639] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1292.693790] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1292.693930] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1292.694128] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.694407] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.694573] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.694697] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.694979] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.695133] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e0e10a3-c237-4ad1-951d-1e08d165b0a0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.922993] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.923206] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.923278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.923496] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.923587] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.923774] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.923865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.923918] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.924082] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.924180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.924282] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 already deleted. [ 1292.924366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.197341] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.197731] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.197731] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.197949] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.198114] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.198363] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 2e0e10a3-c237-4ad1-951d-1e08d165b0a0 not found, creating... [ 1293.198648] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.198815] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.198939] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.199190] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.199343] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.199633] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.199793] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.199919] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.200151] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.200287] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.200433] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 2e0e10a3-c237-4ad1-951d-1e08d165b0a0 is going to be created. [ 1293.219834] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.219930] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.220041] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.220773] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.220773] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.220901] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.797521] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.797704] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.797840] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.797994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.798107] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.906282] env[69499]: INFO networking_nsxv3.common.synchronization [req-5e228067-547e-4b10-9af7-55ced8eb5495 req-d5c8c3ac-7c88-463d-8fcb-d3ae1f7ec528 service nova] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_rules [ 1293.906282] env[69499]: INFO networking_nsxv3.common.synchronization [req-5e228067-547e-4b10-9af7-55ced8eb5495 req-d5c8c3ac-7c88-463d-8fcb-d3ae1f7ec528 service nova] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1293.906282] env[69499]: INFO networking_nsxv3.common.synchronization [req-5e228067-547e-4b10-9af7-55ced8eb5495 req-d5c8c3ac-7c88-463d-8fcb-d3ae1f7ec528 service nova] Enqueued Resource ID: 2e0e10a3-c237-4ad1-951d-1e08d165b0a0 with Priority: HIGHEST for action port [ 1293.906282] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_rules [ 1293.906282] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1293.906282] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0e10a3-c237-4ad1-951d-1e08d165b0a0 with Priority: HIGHEST for action port [ 1293.906282] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.906282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.906282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.906282] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.906282] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.907679] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.907789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.907907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.908055] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.908198] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.908297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.908351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.908499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.908576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.909215] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.909606] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.909606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.909606] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.909787] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.909787] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e0e10a3-c237-4ad1-951d-1e08d165b0a0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.097674] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd in Status: SUCCESS [ 1294.097900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.300723] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.412527] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.412696] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.412917] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.413871] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e0e10a3-c237-4ad1-951d-1e08d165b0a0 with status ACTIVE [ 1294.414070] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.414427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.414427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.414538] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.414584] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.414718] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.414812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.414877] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.415042] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.415126] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.415306] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.415454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.415528] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.415671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.415738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.415824] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e0e10a3-c237-4ad1-951d-1e08d165b0a0 is going to be updated. [ 1294.434803] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.434922] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.434989] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.435180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.435307] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.435515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.803921] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.917654] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.306049] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1295.306521] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1295.420384] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.420536] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.420710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.420962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.421152] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.421269] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be created. [ 1295.455035] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.455035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.455035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.455035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.455035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.463477] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: UNINITIALIZED for 2s [ 1295.610295] env[69499]: INFO networking_nsxv3.common.synchronization [req-ee463056-248c-4e6a-9b4d-e59024d38daf req-5910d9f1-e3ad-4a3f-b21e-02d815ff8eb9 tempest-ServersNegativeTestJSON-1527094857 tempest-ServersNegativeTestJSON-1527094857-project-member] Enqueued Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_members [ 1295.610723] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGHEST for action security_group_members [ 1295.611052] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.611247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.611336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.611519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.611720] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.611828] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.611887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.612056] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.612139] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.612231] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.068578] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.068772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.068823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.069065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.083586] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1296.084422] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.085186] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1296.113921] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.114099] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.114099] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.114300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.114390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.114580] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.114679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.114740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.114889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.114964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.115061] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 is going to be updated. [ 1296.140282] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.140474] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.140565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.140788] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.154515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.155272] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:1. [ 1296.155364] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'2e0e10a3-c237-4ad1-951d-1e08d165b0a0'} {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.155490] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1296.157545] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.157666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.157734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.157906] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.158030] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.183690] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: IN_PROGRESS for 2s [ 1296.207304] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.207438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.207505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.207686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.208866] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.209045] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1296.299558] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.299789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.299789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.300037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.300358] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.300666] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1296.388037] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.388480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.388480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.388576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.388916] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.389236] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 1296.389345] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b0b620e3-40b3-45d3-a3ab-72d49b0bf520', '40dc31b3-f317-4f68-a90f-eaf8e6587e97', 'e3b4e2d2-bd4c-4aa0-be81-75c881b79d89', 'cc6ae0d0-f570-4d5f-9306-819f04632ed6', 'b776cc4b-727c-486a-84a0-2fec84d7f56d', 'cf01aae2-c409-4ed9-940b-99698ec3968f', '2b5ab2a6-a426-4cab-ae0e-330b8062bbf5', '717f63b4-82e8-4749-8d24-1abe7790389b', 'fd1b70ed-24ca-4742-b6ba-0af6127fef74', '31a7bec7-75f3-4780-ac90-0f2f7e7744e9', '4968c8b1-e03b-4720-ad0c-9445bc9427b6', '1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5', '10e373b9-4e6a-452b-b0ab-03e94d0ab90a', 'e09f4b16-4225-4fb9-9fc8-6dca20ac4d41', '032cabed-a789-4100-95a3-6e4998fdb5cc', 'ffce52a9-70af-448f-a2c4-9791dde804d4', '547a2dde-952d-4847-b831-1393133e5c28', '8d458bfd-aa6f-4b52-9c71-7e427269cf82', 'a240c519-0037-4bca-bd0c-b35068bcd700', '478dd7f8-67f8-49a4-9685-e070fbf463f1', '8579ac1e-c68a-42fa-957e-e205942d2fbc', '22e872cc-d333-48f4-bf51-8df73b1a70e3', '99e9e6e3-beeb-4449-ad6b-772723544abd', 'a709c207-f73f-472d-bc52-25ccd049c6fc', '04847a44-8459-4dcc-b6cd-80a364fba3d0', '35e560ef-ae12-4b78-9fd4-fb9be25e66dd', '54331bd8-45ec-4f27-a691-e602cc0be614', 'bfb7458a-4a70-45c1-acb5-648c53b6821a', 'd2b93818-38bc-46b2-af63-51d39fce766c', '13d987c8-57de-4cf5-acd3-eb580bd10337', '29ac832b-134e-49c9-ac8a-2171fbc0640f', '2c949eb0-ea91-4eb0-b5ec-7d14a24a5cbc', '3b269f87-89e9-484d-8baa-02ac9f5f2e89', '44133d71-0f30-4e7f-9c96-2491812bcd1f', 'dba52dd6-05d0-4283-ba0e-107ad8c10157', 'f140365e-2848-4938-ba34-06e4b21ec256', 'f909dc53-3f94-4644-a89e-154a39dd9695', '68bf910a-7d9f-4466-9028-7ab38c7fc30d', 'c0fc2518-1857-49ca-8dcd-c34aaa8c5c22', '39342f68-f184-4c9d-a63b-6e7eb4959f38', '2a81501c-f74a-48d9-97d5-db6c60895c60'} {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.389443] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1296.407393] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.407562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.407635] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.407846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.407935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.408062] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1296.408135] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.408260] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1296.476914] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.477073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.477144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.477354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.478955] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.479253] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1296.479338] env[69499]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69499) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.479413] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1296.479495] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Ports [ 1296.479620] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e0e10a3-c237-4ad1-951d-1e08d165b0a0 with Priority: HIGH for action port [ 1296.479718] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 19/41 resources of Type:Security Group Rules [ 1296.479805] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 with Priority: HIGH for action security_group_rules [ 1296.479878] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 with Priority: HIGH for action security_group_rules [ 1296.479955] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGH for action security_group_rules [ 1296.480041] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGH for action security_group_rules [ 1296.480108] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b776cc4b-727c-486a-84a0-2fec84d7f56d with Priority: HIGH for action security_group_rules [ 1296.480186] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGH for action security_group_rules [ 1296.480257] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGH for action security_group_rules [ 1296.480349] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGH for action security_group_rules [ 1296.480452] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGH for action security_group_rules [ 1296.480561] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGH for action security_group_rules [ 1296.480634] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGH for action security_group_rules [ 1296.480696] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 with Priority: HIGH for action security_group_rules [ 1296.480760] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a with Priority: HIGH for action security_group_rules [ 1296.480822] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGH for action security_group_rules [ 1296.480899] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGH for action security_group_rules [ 1296.480965] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ffce52a9-70af-448f-a2c4-9791dde804d4 with Priority: HIGH for action security_group_rules [ 1296.481037] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGH for action security_group_rules [ 1296.481124] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 with Priority: HIGH for action security_group_rules [ 1296.481197] env[69499]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a240c519-0037-4bca-bd0c-b35068bcd700 with Priority: HIGH for action security_group_rules [ 1296.481285] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.471629] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1297.471980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.471980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.472233] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.472388] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.472505] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.472569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.472726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.472806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.472891] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.472977] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.975207] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.975439] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.975484] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.975694] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.975898] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.976100] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.976100] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.976244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.976363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.976452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.976595] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.976684] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.976742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.976882] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.977030] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.977122] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.977183] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.977367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.977462] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.977555] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.977644] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.192416] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 in Status: SUCCESS [ 1298.192416] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 deletion is rescheduled due to dependency. [ 1298.192416] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.480083] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7217eab0-c018-4859-a8da-01f90f62c7f0: rpc.has_security_group_logging(os_id): False [ 1298.498961] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.499125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.499180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.499369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.499455] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.499649] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.499743] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.499804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.499953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.500039] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.500220] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.500313] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.500372] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.500509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.500580] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.500748] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.500836] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.500895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.501037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.501172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.501272] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be created. [ 1298.554942] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.555144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.555144] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.555345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.555524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.565270] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1300.577447] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1300.577825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.611457] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1300.611655] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1300.611706] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0e10a3-c237-4ad1-951d-1e08d165b0a0 with Priority: HIGH for action port [ 1300.611801] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 with Priority: HIGH for action security_group_rules [ 1300.611889] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf01aae2-c409-4ed9-940b-99698ec3968f with Priority: HIGH for action security_group_rules [ 1300.612017] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 with Priority: HIGH for action security_group_rules [ 1300.612089] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a240c519-0037-4bca-bd0c-b35068bcd700 with Priority: HIGH for action security_group_rules [ 1300.612206] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 with Priority: HIGH for action security_group_rules [ 1300.612267] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 547a2dde-952d-4847-b831-1393133e5c28 with Priority: HIGH for action security_group_rules [ 1300.612358] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffce52a9-70af-448f-a2c4-9791dde804d4 with Priority: HIGH for action security_group_rules [ 1300.612452] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a with Priority: HIGH for action security_group_rules [ 1300.612533] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032cabed-a789-4100-95a3-6e4998fdb5cc with Priority: HIGH for action security_group_rules [ 1300.612619] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 with Priority: HIGH for action security_group_rules [ 1300.612702] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 with Priority: HIGH for action security_group_rules [ 1300.612792] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 with Priority: HIGH for action security_group_rules [ 1300.612886] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 with Priority: HIGH for action security_group_rules [ 1300.612956] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGH for action security_group_rules [ 1300.613058] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b776cc4b-727c-486a-84a0-2fec84d7f56d with Priority: HIGH for action security_group_rules [ 1300.613202] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 with Priority: HIGH for action security_group_rules [ 1300.613461] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 with Priority: HIGH for action security_group_rules [ 1300.613597] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 with Priority: HIGH for action security_group_rules [ 1300.613668] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 with Priority: HIGH for action security_group_rules [ 1300.614019] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.614193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.614268] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.614487] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.614570] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e0e10a3-c237-4ad1-951d-1e08d165b0a0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.615609] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40dc31b3-f317-4f68-a90f-eaf8e6587e97 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.619026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.619026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.619026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.619026] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40dc31b3-f317-4f68-a90f-eaf8e6587e97',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.619026] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf01aae2-c409-4ed9-940b-99698ec3968f taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.619026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.619026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.619026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.619026] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf01aae2-c409-4ed9-940b-99698ec3968f',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.619026] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.619026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.619026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.619026] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.619026] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e09f4b16-4225-4fb9-9fc8-6dca20ac4d41',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.619823] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a240c519-0037-4bca-bd0c-b35068bcd700 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.619823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.619823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.619823] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.619823] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a240c519-0037-4bca-bd0c-b35068bcd700',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.620217] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.620319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.620366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.620511] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.621093] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d458bfd-aa6f-4b52-9c71-7e427269cf82',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.622237] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-547a2dde-952d-4847-b831-1393133e5c28 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.622397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.622574] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.622867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.623010] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('547a2dde-952d-4847-b831-1393133e5c28',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.624077] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffce52a9-70af-448f-a2c4-9791dde804d4 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.624283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.624325] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.624553] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.624841] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffce52a9-70af-448f-a2c4-9791dde804d4',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.625545] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.625701] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.625889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.626126] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.626237] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10e373b9-4e6a-452b-b0ab-03e94d0ab90a',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.627150] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-032cabed-a789-4100-95a3-6e4998fdb5cc taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.627331] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.627818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.627818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.627818] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('032cabed-a789-4100-95a3-6e4998fdb5cc',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.629187] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.629615] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.630327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.630327] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.630327] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.631233] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.631383] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.631493] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.632510] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.632510] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4968c8b1-e03b-4720-ad0c-9445bc9427b6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.632767] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.632934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.633061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.633554] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.633681] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31a7bec7-75f3-4780-ac90-0f2f7e7744e9',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.634601] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.634766] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.634879] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.635125] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.635257] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd1b70ed-24ca-4742-b6ba-0af6127fef74',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.636305] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.636740] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.636879] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.637134] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.637265] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.638580] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b776cc4b-727c-486a-84a0-2fec84d7f56d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.638830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.638964] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.639212] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.639449] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b776cc4b-727c-486a-84a0-2fec84d7f56d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.640510] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.640673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.640789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.641035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.641161] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b5ab2a6-a426-4cab-ae0e-330b8062bbf5',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.642324] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.642492] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.642580] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.643019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.643019] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc6ae0d0-f570-4d5f-9306-819f04632ed6',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.643853] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b620e3-40b3-45d3-a3ab-72d49b0bf520 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.644315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.644315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.644442] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.644504] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b620e3-40b3-45d3-a3ab-72d49b0bf520',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.645765] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.645765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.645765] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.646032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.646154] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3b4e2d2-bd4c-4aa0-be81-75c881b79d89',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.163766] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e0e10a3-c237-4ad1-951d-1e08d165b0a0 with status ACTIVE [ 1301.163927] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.164588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.164588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.164588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.164588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.164885] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.164885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.164885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.165008] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.165113] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.165262] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.165384] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.165512] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.166681] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.166681] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.166681] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e0e10a3-c237-4ad1-951d-1e08d165b0a0 is going to be updated. [ 1301.169283] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.169412] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.169466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.169624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.169790] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.169885] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.169945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.170101] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.170179] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.171595] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.171595] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.224816] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.224940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.225068] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.225238] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.226849] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.226963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.229169] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.229267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.231801] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.231981] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.232776] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.232872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.234025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.234171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.234864] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.234973] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.235811] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.235904] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.243274] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.243274] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.248171] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.248171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.250061] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.250137] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.250821] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1301.251195] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.251301] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.252345] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1301.252760] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.253275] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.254330] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1301.254566] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.254643] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.255307] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1301.255717] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.256019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.256457] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1301.256852] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.257476] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.257651] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1301.258122] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.258261] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.258714] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1301.259106] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.259208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.260255] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1301.260693] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.260807] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40dc31b3-f317-4f68-a90f-eaf8e6587e97 is going to be deleted. [ 1301.261988] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.261988] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.263486] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.263592] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.263663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.263824] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.264351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.264351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e0e10a3-c237-4ad1-951d-1e08d165b0a0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.283397] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.283519] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a240c519-0037-4bca-bd0c-b35068bcd700 is going to be deleted. [ 1301.284758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.284963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.317440] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.317591] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b776cc4b-727c-486a-84a0-2fec84d7f56d is going to be deleted. [ 1301.318477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.318682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.342130] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.342304] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.351086] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.351253] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5 is going to be deleted. [ 1301.352542] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.352751] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.396739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.396988] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3b4e2d2-bd4c-4aa0-be81-75c881b79d89 is going to be deleted. [ 1301.398796] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.398796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.398796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.398796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.398796] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.399246] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a240c519-0037-4bca-bd0c-b35068bcd700" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.399246] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.399317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.403124] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.403124] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.453972] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.453972] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.468437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.468562] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e09f4b16-4225-4fb9-9fc8-6dca20ac4d41 is going to be deleted. [ 1301.469451] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.469662] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.518409] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.518523] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffce52a9-70af-448f-a2c4-9791dde804d4 is going to be deleted. [ 1301.519425] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.519649] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.578844] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.579287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.580930] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.581054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.600682] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.600842] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf01aae2-c409-4ed9-940b-99698ec3968f is going to be deleted. [ 1301.601848] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.602072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.641225] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.641427] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.643725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.643843] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10e373b9-4e6a-452b-b0ab-03e94d0ab90a is going to be deleted. [ 1301.644720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.644924] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.670257] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.670379] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b5ab2a6-a426-4cab-ae0e-330b8062bbf5 is going to be deleted. [ 1301.671133] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.671345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.687783] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.718600] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.718738] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.755103] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.755218] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 547a2dde-952d-4847-b831-1393133e5c28 is going to be deleted. [ 1301.756011] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.756216] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.793418] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.793556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.814976] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.815117] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4968c8b1-e03b-4720-ad0c-9445bc9427b6 is going to be deleted. [ 1301.815927] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.816142] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.871872] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.872015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.876614] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.876710] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.891248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.891357] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 032cabed-a789-4100-95a3-6e4998fdb5cc is going to be deleted. [ 1301.892163] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.892369] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.939156] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.939260] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd1b70ed-24ca-4742-b6ba-0af6127fef74 is going to be deleted. [ 1301.940107] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.940328] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.005999] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.006164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.014495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.014601] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b620e3-40b3-45d3-a3ab-72d49b0bf520 is going to be deleted. [ 1302.015367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.015562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.017693] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.017791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.044811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.044913] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc6ae0d0-f570-4d5f-9306-819f04632ed6 is going to be deleted. [ 1302.045628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.045813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.191038] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 717f63b4-82e8-4749-8d24-1abe7790389b: rpc.has_security_group_logging(os_id): False [ 1302.269568] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.269764] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.272701] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.272822] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d458bfd-aa6f-4b52-9c71-7e427269cf82 is going to be deleted. [ 1302.273774] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.273979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.274087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.274222] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40dc31b3-f317-4f68-a90f-eaf8e6587e97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.274894] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.274992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.275088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.275254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.275338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.275454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd1b70ed-24ca-4742-b6ba-0af6127fef74" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.276126] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.276222] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.276292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.276443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.277661] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.277758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.310174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.310420] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.310501] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.310569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.310725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.310804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.310895] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be updated. [ 1302.311803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.311962] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.312061] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.312176] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ed2cfa4-8ba3-4b13-9ccd-e4d1620ce7a5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.312295] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.312440] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.312515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.312626] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3b4e2d2-bd4c-4aa0-be81-75c881b79d89" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.312760] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.312900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.312975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.313098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e09f4b16-4225-4fb9-9fc8-6dca20ac4d41" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.313243] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.313388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.313464] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.313574] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffce52a9-70af-448f-a2c4-9791dde804d4" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.314176] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.314338] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.314426] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.314545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf01aae2-c409-4ed9-940b-99698ec3968f" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.314666] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.314812] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.314890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.315009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10e373b9-4e6a-452b-b0ab-03e94d0ab90a" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.315147] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.315288] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.315366] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.315473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b5ab2a6-a426-4cab-ae0e-330b8062bbf5" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.315602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.315747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.315821] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.315945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-547a2dde-952d-4847-b831-1393133e5c28" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.316067] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.316209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.316286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.316390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4968c8b1-e03b-4720-ad0c-9445bc9427b6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.316500] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.316637] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.316709] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.316817] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-032cabed-a789-4100-95a3-6e4998fdb5cc" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.316940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.317090] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.317166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.317272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b620e3-40b3-45d3-a3ab-72d49b0bf520" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.317431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.317535] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.317588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.317680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc6ae0d0-f570-4d5f-9306-819f04632ed6" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.317804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.317942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.370208] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.370330] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31a7bec7-75f3-4780-ac90-0f2f7e7744e9 is going to be deleted. [ 1302.371175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.371306] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.371394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.371510] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b776cc4b-727c-486a-84a0-2fec84d7f56d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.458615] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.458782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.458843] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.459059] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.459153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.459279] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d458bfd-aa6f-4b52-9c71-7e427269cf82" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.488347] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.488524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.488579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.488757] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.488895] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.490495] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.490609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.490689] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.490852] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.490935] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.491079] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31a7bec7-75f3-4780-ac90-0f2f7e7744e9" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.505876] env[69499]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1302.506287] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 2s [ 1303.654416] env[69499]: INFO networking_nsxv3.common.synchronization [req-aeca24f8-7eaa-485c-bb08-d5b345eb8e12 req-d78c52f9-cf86-42cb-be48-deb98ab0f7af tempest-DeleteServersTestJSON-831065566 tempest-DeleteServersTestJSON-831065566-project-member] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1303.655678] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1303.655678] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.655678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.655678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.655678] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.656014] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.656014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.656014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.656221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.656221] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.656221] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.163404] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.163648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.163700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.163948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.164085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.164772] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.164772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.164772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.164772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.164772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.164772] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1304.191525] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.191698] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.191758] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.191908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.192053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.199986] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1304.519381] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1304.519683] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.218050] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1306.218050] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 deletion is rescheduled due to dependency. [ 1306.218050] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.921994] env[69499]: INFO networking_nsxv3.common.synchronization [req-ab80b56f-83f1-4fa2-a150-63f09264a145 req-6dd9cf85-84e4-44b6-a2c6-d1cd7248b190 tempest-ServerActionsTestOtherA-389553511 tempest-ServerActionsTestOtherA-389553511-project-member] Enqueued Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_members [ 1306.922543] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd with Priority: HIGHEST for action security_group_members [ 1306.923490] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.923490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.923490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.923490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.923490] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.923490] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.923871] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.923871] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.923871] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.923871] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35e560ef-ae12-4b78-9fd4-fb9be25e66dd',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.426133] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.426518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.426518] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.426600] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.446819] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.447062] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.447185] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.447248] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.447436] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.447522] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.447609] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd is going to be updated. [ 1307.472683] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.472776] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.472776] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.472977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.473181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.481109] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd in Status: IN_PROGRESS for 2s [ 1309.491801] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd in Status: SUCCESS [ 1309.491801] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e560ef-ae12-4b78-9fd4-fb9be25e66dd deletion is rescheduled due to dependency. [ 1309.491801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e560ef-ae12-4b78-9fd4-fb9be25e66dd" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.923462] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1311.923733] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1312.972162] env[69499]: INFO networking_nsxv3.common.synchronization [req-feca4584-c048-4f71-a79d-2b30c9b94cdb req-1f40d8ff-b81e-4cb3-b120-1241e22ab6af tempest-DeleteServersTestJSON-831065566 tempest-DeleteServersTestJSON-831065566-project-member] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1312.972515] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1312.972686] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.972809] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.972878] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.973093] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.973245] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.973371] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.973437] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.973592] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.973675] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.973797] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.242616] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.242616] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.242883] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.243101] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.243451] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.243636] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.243817] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.244191] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.244277] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.244521] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1313.244630] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1313.244795] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1313.244873] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1313.245068] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1313.245127] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1313.245251] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1313.267604] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1313.267834] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1313.267988] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1313.268179] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.268523] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-a594f5bf-e2aa-46ee-a064-e141764b2bff taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.268701] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-a594f5bf-e2aa-46ee-a064-e141764b2bff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.268826] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-a594f5bf-e2aa-46ee-a064-e141764b2bff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.269208] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-a594f5bf-e2aa-46ee-a064-e141764b2bff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.269354] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a594f5bf-e2aa-46ee-a064-e141764b2bff',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.475817] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.476047] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.476047] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.476247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.476339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.476542] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.476636] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.476697] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.476892] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.476979] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.477079] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1313.503341] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.503510] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.503560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.503744] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.503886] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.514928] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1313.771498] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.771750] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.771893] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.772230] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.772417] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.772586] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port a594f5bf-e2aa-46ee-a064-e141764b2bff not found, creating... [ 1313.772852] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.773017] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.773139] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.773386] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.773534] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.773856] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.774046] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.774188] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.774418] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.774519] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.774664] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: a594f5bf-e2aa-46ee-a064-e141764b2bff is going to be created. [ 1313.810814] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.811049] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.811148] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.811393] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.811619] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.811833] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-a594f5bf-e2aa-46ee-a064-e141764b2bff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.483402] env[69499]: INFO networking_nsxv3.common.synchronization [req-feca4584-c048-4f71-a79d-2b30c9b94cdb req-1cbcbfe3-8e98-4ffe-abb3-7a4a5bc3818f service nova] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_rules [ 1314.483781] env[69499]: INFO networking_nsxv3.common.synchronization [req-feca4584-c048-4f71-a79d-2b30c9b94cdb req-1cbcbfe3-8e98-4ffe-abb3-7a4a5bc3818f service nova] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1314.483781] env[69499]: INFO networking_nsxv3.common.synchronization [req-feca4584-c048-4f71-a79d-2b30c9b94cdb req-1cbcbfe3-8e98-4ffe-abb3-7a4a5bc3818f service nova] Enqueued Resource ID: a594f5bf-e2aa-46ee-a064-e141764b2bff with Priority: HIGHEST for action port [ 1314.484048] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_rules [ 1314.484182] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1314.484278] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a594f5bf-e2aa-46ee-a064-e141764b2bff with Priority: HIGHEST for action port [ 1314.484834] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.484992] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.485131] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.485363] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.485466] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.486360] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.486485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.486701] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-a594f5bf-e2aa-46ee-a064-e141764b2bff taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.487467] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a594f5bf-e2aa-46ee-a064-e141764b2bff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.487467] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a594f5bf-e2aa-46ee-a064-e141764b2bff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.487467] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a594f5bf-e2aa-46ee-a064-e141764b2bff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.487467] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a594f5bf-e2aa-46ee-a064-e141764b2bff',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.850431] env[69499]: INFO networking_nsxv3.common.synchronization [None req-91464731-2010-4e4e-9dfa-3b21a28b29d9 None None] Enqueued Resource ID: 16cda317-af79-4c8c-9de9-e38d87ea183c with Priority: HIGHEST for action port [ 1314.850706] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16cda317-af79-4c8c-9de9-e38d87ea183c with Priority: HIGHEST for action port [ 1314.851290] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-16cda317-af79-4c8c-9de9-e38d87ea183c taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.851430] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16cda317-af79-4c8c-9de9-e38d87ea183c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.851485] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16cda317-af79-4c8c-9de9-e38d87ea183c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.851729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16cda317-af79-4c8c-9de9-e38d87ea183c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.851806] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16cda317-af79-4c8c-9de9-e38d87ea183c',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.989583] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.989583] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.989583] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a594f5bf-e2aa-46ee-a064-e141764b2bff with status ACTIVE [ 1314.989821] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.989821] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.990047] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.990130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.990193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.990368] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.990465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.990527] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.990717] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.990828] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.991025] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.991111] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.991172] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.991346] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.991432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.991519] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a594f5bf-e2aa-46ee-a064-e141764b2bff is going to be updated. [ 1315.015722] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.015722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.015722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.015722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.015722] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.016032] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a594f5bf-e2aa-46ee-a064-e141764b2bff" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.354500] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16cda317-af79-4c8c-9de9-e38d87ea183c [ 1315.354694] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.354832] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.354901] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.355158] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.355271] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.355393] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16cda317-af79-4c8c-9de9-e38d87ea183c already deleted. [ 1315.355486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16cda317-af79-4c8c-9de9-e38d87ea183c" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.525109] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1315.525335] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 deletion is rescheduled due to dependency. [ 1315.525409] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.525559] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.525795] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.526370] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.526370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.526370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.526370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.526370] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.526607] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.029116] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.531295] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.033929] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.034128] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.034198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.034449] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.034556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.034660] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1317.049891] env[69499]: INFO networking_nsxv3.common.synchronization [None req-24ccb569-23a2-4f41-ae17-1ea7978d2572 None None] Enqueued Resource ID: 18729201-8925-4253-a777-cc647b0f6c44 with Priority: HIGHEST for action port [ 1317.050161] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18729201-8925-4253-a777-cc647b0f6c44 with Priority: HIGHEST for action port [ 1317.050767] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-18729201-8925-4253-a777-cc647b0f6c44 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.050907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18729201-8925-4253-a777-cc647b0f6c44" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.050975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18729201-8925-4253-a777-cc647b0f6c44" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.051224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18729201-8925-4253-a777-cc647b0f6c44" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.051305] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18729201-8925-4253-a777-cc647b0f6c44',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.063829] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.063959] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.064037] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.064210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.064349] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.071849] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1317.553107] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18729201-8925-4253-a777-cc647b0f6c44 [ 1317.553415] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.553546] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.553674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.553802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.553886] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.553981] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18729201-8925-4253-a777-cc647b0f6c44 already deleted. [ 1317.554118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18729201-8925-4253-a777-cc647b0f6c44" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.084555] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1319.084890] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.084975] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.085232] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.085448] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.085596] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.085846] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.086092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.086205] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.086311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.086406] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.589268] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.589494] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.589494] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.589663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.589827] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.589931] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.590019] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.590195] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.590311] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.590355] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.590488] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.590581] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.590641] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.590783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.590919] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.591017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.591081] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.591217] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.591292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.591433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.591536] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.094042] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7217eab0-c018-4859-a8da-01f90f62c7f0: rpc.has_security_group_logging(os_id): False [ 1320.110404] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.110565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.110636] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.110816] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.110906] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.111126] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.111230] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.111302] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.111456] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.111539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.111775] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.111908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.111967] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.112110] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.112215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.112364] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.112946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.112946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.112946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.112946] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.112946] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1320.181261] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.181452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.181452] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.181656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.181798] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.195332] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1322.051446] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.051854] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1322.209712] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1322.209939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.365548] env[69499]: INFO networking_nsxv3.common.synchronization [req-8a2392db-a503-4cd9-bb69-f7a0ed4b00e1 req-32f14c00-d015-4540-abe1-c938de9caa6b tempest-ServerTagsTestJSON-1259340891 tempest-ServerTagsTestJSON-1259340891-project-member] Enqueued Resource ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 with Priority: HIGHEST for action security_group_members [ 1322.366140] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 with Priority: HIGHEST for action security_group_members [ 1322.366454] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.366594] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.366674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.366948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.367097] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.367197] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.367256] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.367414] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.367495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.367584] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c061ac4-e5fb-4436-9506-3c1a3ea2ef86',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.624744] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-178 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.625241] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-178" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.625241] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-178" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.625473] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-178" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.625708] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.625887] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.625887] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.626298] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.626466] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.626707] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1322.627106] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1322.627106] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1322.627106] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1322.627537] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1322.627537] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1322.627537] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1322.645432] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1322.645586] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1322.645748] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1322.645943] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-178" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.646241] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-065b15d4-4cb1-4fad-b088-955953768d97 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.646412] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-065b15d4-4cb1-4fad-b088-955953768d97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.646536] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-065b15d4-4cb1-4fad-b088-955953768d97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.646822] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-065b15d4-4cb1-4fad-b088-955953768d97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.646968] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('065b15d4-4cb1-4fad-b088-955953768d97',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.869278] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.869475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.869475] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.869700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.869789] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.869976] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.870091] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.870155] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.870305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.870405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.870466] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 already deleted. [ 1322.870573] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.149216] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.149620] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.149620] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.149779] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.149911] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.150093] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 065b15d4-4cb1-4fad-b088-955953768d97 not found, creating... [ 1323.150382] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.150545] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.150671] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.150888] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.151041] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.151346] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.151528] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.151683] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.151834] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.152012] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.152121] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 065b15d4-4cb1-4fad-b088-955953768d97 is going to be created. [ 1323.171030] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.171185] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.171322] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.171550] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.171772] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.171986] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-065b15d4-4cb1-4fad-b088-955953768d97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.849295] env[69499]: INFO networking_nsxv3.common.synchronization [req-8a2392db-a503-4cd9-bb69-f7a0ed4b00e1 req-fbab9ef5-9f01-4b51-8617-860a5e76e904 service nova] Enqueued Resource ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 with Priority: HIGHEST for action security_group_rules [ 1323.849501] env[69499]: INFO networking_nsxv3.common.synchronization [req-8a2392db-a503-4cd9-bb69-f7a0ed4b00e1 req-fbab9ef5-9f01-4b51-8617-860a5e76e904 service nova] Enqueued Resource ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 with Priority: HIGHEST for action security_group_members [ 1323.849664] env[69499]: INFO networking_nsxv3.common.synchronization [req-8a2392db-a503-4cd9-bb69-f7a0ed4b00e1 req-fbab9ef5-9f01-4b51-8617-860a5e76e904 service nova] Enqueued Resource ID: 065b15d4-4cb1-4fad-b088-955953768d97 with Priority: HIGHEST for action port [ 1323.849893] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 with Priority: HIGHEST for action security_group_rules [ 1323.850041] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 with Priority: HIGHEST for action security_group_members [ 1323.850150] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 065b15d4-4cb1-4fad-b088-955953768d97 with Priority: HIGHEST for action port [ 1323.850679] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.850801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.850865] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.851121] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.851205] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c061ac4-e5fb-4436-9506-3c1a3ea2ef86',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.851987] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.852115] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.852182] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.852345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.852550] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.852598] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.852673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.852801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.852896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.852984] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c061ac4-e5fb-4436-9506-3c1a3ea2ef86',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.853715] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-065b15d4-4cb1-4fad-b088-955953768d97 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.853889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-065b15d4-4cb1-4fad-b088-955953768d97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.853889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-065b15d4-4cb1-4fad-b088-955953768d97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.854046] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-065b15d4-4cb1-4fad-b088-955953768d97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.854171] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('065b15d4-4cb1-4fad-b088-955953768d97',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.356152] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c061ac4-e5fb-4436-9506-3c1a3ea2ef86',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.357471] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.357614] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.358078] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 065b15d4-4cb1-4fad-b088-955953768d97 with status ACTIVE [ 1324.358292] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.358435] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.358534] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.358825] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.358942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.359177] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.359305] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.359391] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.359601] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.359706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.359947] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.360085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.360169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.360353] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.360479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.360566] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 065b15d4-4cb1-4fad-b088-955953768d97 is going to be updated. [ 1324.379692] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.379850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.379947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.380177] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.380336] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.380521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-065b15d4-4cb1-4fad-b088-955953768d97" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.858603] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c061ac4-e5fb-4436-9506-3c1a3ea2ef86',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.361925] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.362300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.362300] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.362445] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.362537] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.362639] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 is going to be created. [ 1325.384535] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.384712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.384712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.384902] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.385065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.392834] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 in Status: UNINITIALIZED for 2s [ 1327.403695] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 in Status: SUCCESS [ 1327.404118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.404184] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.404374] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.404649] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.404732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.404776] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.404900] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.404983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.405083] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.405174] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c061ac4-e5fb-4436-9506-3c1a3ea2ef86',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.908072] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.908072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.908072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.908072] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.908562] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.908736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.908827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.909070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.909130] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.909216] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.909378] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.909489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.909552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.909714] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.909889] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.909983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.910055] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.910201] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.910297] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.910360] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.910451] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c061ac4-e5fb-4436-9506-3c1a3ea2ef86',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.413156] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86: rpc.has_security_group_logging(os_id): False [ 1328.429819] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.430029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.430029] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.430252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.430345] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.430573] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.430676] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.430739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.430896] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.430972] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.431164] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.431260] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.431322] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.431521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.431601] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.431786] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.431880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.431939] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.432092] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.432165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.432250] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 is going to be created. [ 1328.485965] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.486189] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.486189] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.486392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.486576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.496259] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 in Status: IN_PROGRESS for 2s [ 1328.851068] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1328.851333] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1330.508837] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 in Status: SUCCESS [ 1330.509195] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.852191] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1333.852477] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1335.119649] env[69499]: INFO networking_nsxv3.common.synchronization [req-04a553ac-8807-4e9c-aa82-3f5b33be978c req-a6264f5d-d37e-4caa-b93f-2e2e36cea1c2 tempest-ServerTagsTestJSON-1259340891 tempest-ServerTagsTestJSON-1259340891-project-member] Enqueued Resource ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 with Priority: HIGHEST for action security_group_members [ 1335.120444] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 with Priority: HIGHEST for action security_group_members [ 1335.120619] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.120679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.120762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.121188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.121710] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.121842] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.121905] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.122138] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.122210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.122403] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c061ac4-e5fb-4436-9506-3c1a3ea2ef86',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.625371] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.625602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.625602] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.625807] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.625947] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.626190] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.626312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.626378] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.626566] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.626674] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.626765] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 is going to be updated. [ 1335.653084] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.653084] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.653433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.653433] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.653611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.661291] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 in Status: IN_PROGRESS for 2s [ 1337.672898] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 in Status: SUCCESS [ 1337.673332] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c061ac4-e5fb-4436-9506-3c1a3ea2ef86 deletion is rescheduled due to dependency. [ 1337.673332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c061ac4-e5fb-4436-9506-3c1a3ea2ef86" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.838661] env[69499]: INFO networking_nsxv3.common.synchronization [req-e43472d7-c265-4f89-98c0-4aa0f5c6543c req-a8a95630-aaf3-449c-b0c5-dab9de3cf68a tempest-DeleteServersTestJSON-831065566 tempest-DeleteServersTestJSON-831065566-project-member] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1338.839347] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1338.839672] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.839867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.839983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.840210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.840377] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.840478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.840551] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.840741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.840888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.841030] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.343503] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.343695] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.343767] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.343988] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.344094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.344289] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.344390] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.344444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.344605] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.344686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.344775] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1339.371692] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.371849] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.371950] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.372190] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.372365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.380593] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1341.391590] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1341.391986] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 deletion is rescheduled due to dependency. [ 1341.391986] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.841118] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.841425] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.842271] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.842578] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.968302] env[69499]: INFO networking_nsxv3.common.synchronization [req-49b2afc9-d790-4425-8d28-7bba3684973b req-9449dd6d-75eb-4fd9-b88a-d634589e2985 tempest-DeleteServersTestJSON-831065566 tempest-DeleteServersTestJSON-831065566-project-member] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1348.969100] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1348.969100] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.969100] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.969100] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.969351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.969351] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.969440] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.969440] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.969590] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.969697] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.969761] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.236983] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.236983] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.236983] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.236983] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.236983] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.236983] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.236983] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.236983] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.236983] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.236983] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1349.236983] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1349.236983] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1349.236983] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1349.237621] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1349.237621] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1349.237621] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1349.256879] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1349.257016] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1349.257168] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1349.257325] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.257614] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-9e562242-af8a-405d-aee5-defc33bef40e taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.257784] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-9e562242-af8a-405d-aee5-defc33bef40e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.257909] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-9e562242-af8a-405d-aee5-defc33bef40e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.258319] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-9e562242-af8a-405d-aee5-defc33bef40e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.258463] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e562242-af8a-405d-aee5-defc33bef40e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.471789] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.472015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.472015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.472247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.472337] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.472532] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.472633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.472711] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.472867] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.472944] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.473041] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1349.497436] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.497592] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.497592] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.497726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.497856] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.505193] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1349.760979] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.761201] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.761334] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.761611] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.761763] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.761925] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port 9e562242-af8a-405d-aee5-defc33bef40e not found, creating... [ 1349.762209] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.762363] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.762483] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.762698] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.762844] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.763185] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.763372] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.763499] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.763739] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.763890] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.764053] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 9e562242-af8a-405d-aee5-defc33bef40e is going to be created. [ 1349.782445] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.782612] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.782738] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.782967] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.783209] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.783422] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-9e562242-af8a-405d-aee5-defc33bef40e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.656305] env[69499]: INFO networking_nsxv3.common.synchronization [req-49b2afc9-d790-4425-8d28-7bba3684973b req-c73501c5-1403-4d1f-85c8-ef2081080bad service nova] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_rules [ 1350.656563] env[69499]: INFO networking_nsxv3.common.synchronization [req-49b2afc9-d790-4425-8d28-7bba3684973b req-c73501c5-1403-4d1f-85c8-ef2081080bad service nova] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1350.656667] env[69499]: INFO networking_nsxv3.common.synchronization [req-49b2afc9-d790-4425-8d28-7bba3684973b req-c73501c5-1403-4d1f-85c8-ef2081080bad service nova] Enqueued Resource ID: 9e562242-af8a-405d-aee5-defc33bef40e with Priority: HIGHEST for action port [ 1350.656858] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_rules [ 1350.656986] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1350.657095] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e562242-af8a-405d-aee5-defc33bef40e with Priority: HIGHEST for action port [ 1350.657682] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.657762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.657835] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.658040] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.658126] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.658908] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.659014] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.659590] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e562242-af8a-405d-aee5-defc33bef40e taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.659706] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e562242-af8a-405d-aee5-defc33bef40e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.659775] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e562242-af8a-405d-aee5-defc33bef40e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.659942] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e562242-af8a-405d-aee5-defc33bef40e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.660022] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e562242-af8a-405d-aee5-defc33bef40e',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.162087] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.162267] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.163686] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e562242-af8a-405d-aee5-defc33bef40e with status ACTIVE [ 1351.163958] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.164118] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.164209] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.164454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.164574] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.164789] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.164887] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.164963] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.165193] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.165292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.165521] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.165645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.165729] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.165907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.165994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.166096] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e562242-af8a-405d-aee5-defc33bef40e is going to be updated. [ 1351.189549] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.189708] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.189755] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.189953] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.190126] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.190313] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e562242-af8a-405d-aee5-defc33bef40e" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.515016] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1351.515198] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 deletion is rescheduled due to dependency. [ 1351.515283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.515441] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.515648] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.515828] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.515945] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.516021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.516164] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.516241] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.516333] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.019620] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.521412] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.023818] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.024176] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.024176] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.024324] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.024417] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.024515] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1353.048949] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.049124] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.049124] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.049309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.049448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.056736] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1355.067924] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1355.068192] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.068333] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.068548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.068739] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.068855] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.068929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.069089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.069170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.069253] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.069343] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.288246] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-728 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.288449] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.288576] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.288882] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.289134] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.289294] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.289412] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.289632] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.289930] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.290022] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1355.290117] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1355.290227] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1355.290338] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1355.290448] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1355.290553] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1355.290684] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1355.308329] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1355.308423] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1355.308474] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1355.308648] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-728" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.308942] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.309130] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.309254] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.309494] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.309634] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86e8aa40-bbb0-4477-bafb-c26b9d1fe217',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.572098] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.572098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.572098] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.572380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.572417] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.572576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.572576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.572762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.572827] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.572878] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.573041] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.573123] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.573175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.573319] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.573460] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.573547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.573673] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.573724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.573837] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.573913] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.574012] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.658323] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.658518] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1355.811780] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.812039] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.812138] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.812433] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.812585] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.812867] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.813038] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.813165] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.813384] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.813526] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.813841] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.814015] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.814143] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.814359] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.814497] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.814646] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: 86e8aa40-bbb0-4477-bafb-c26b9d1fe217 is going to be updated. [ 1355.835693] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.835863] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.835972] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.836226] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.836436] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.836658] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.076393] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7217eab0-c018-4859-a8da-01f90f62c7f0: rpc.has_security_group_logging(os_id): False [ 1356.095271] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.095428] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.095472] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.095680] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.095864] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.095968] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.096100] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.096170] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.096317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.096395] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.096583] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.096690] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.096771] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.096923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.097009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.097193] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.097283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.097339] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.097480] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.097562] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.097754] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1356.158700] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.158921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.158921] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.159365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.159365] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.170652] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1356.552983] env[69499]: INFO networking_nsxv3.common.synchronization [req-36f8a2e7-ee6a-4ba5-bf41-4da4fa5b61ea req-ce8baa1c-99ff-4696-9cb6-349d806d8396 service nova] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_rules [ 1356.553297] env[69499]: INFO networking_nsxv3.common.synchronization [req-36f8a2e7-ee6a-4ba5-bf41-4da4fa5b61ea req-ce8baa1c-99ff-4696-9cb6-349d806d8396 service nova] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1356.553390] env[69499]: INFO networking_nsxv3.common.synchronization [req-36f8a2e7-ee6a-4ba5-bf41-4da4fa5b61ea req-ce8baa1c-99ff-4696-9cb6-349d806d8396 service nova] Enqueued Resource ID: 86e8aa40-bbb0-4477-bafb-c26b9d1fe217 with Priority: HIGHEST for action port [ 1356.553621] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_rules [ 1356.553803] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1356.553875] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86e8aa40-bbb0-4477-bafb-c26b9d1fe217 with Priority: HIGHEST for action port [ 1356.554392] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.554549] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.554604] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.554780] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.554856] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.557027] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.557027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.557027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.557027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.557473] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.557473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.557473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.557473] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.557667] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.557667] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.558404] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.558513] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.558583] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.558734] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.558808] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86e8aa40-bbb0-4477-bafb-c26b9d1fe217',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.062750] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.063155] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.063262] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.063427] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86e8aa40-bbb0-4477-bafb-c26b9d1fe217 with status ACTIVE [ 1357.063583] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.063686] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.063748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.064017] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.064119] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.064313] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.064443] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.064504] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.064624] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.064700] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.064945] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.065482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.065570] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.065725] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.065806] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.066031] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86e8aa40-bbb0-4477-bafb-c26b9d1fe217 is going to be updated. [ 1357.089043] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.089404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.089404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.089404] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.089575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.089663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86e8aa40-bbb0-4477-bafb-c26b9d1fe217" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.568466] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.070514] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.070679] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.070736] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.070960] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.071053] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.071155] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be updated. [ 1358.098042] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.098438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.098438] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.098571] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.098715] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.107137] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 2s [ 1358.184425] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1358.184645] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.116724] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 4s [ 1361.555035] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.555035] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1362.128031] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1362.128031] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.128322] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.128403] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.128618] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.128741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.128809] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.128974] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.129074] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.129166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.129314] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.632020] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.134359] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 717f63b4-82e8-4749-8d24-1abe7790389b: rpc.has_security_group_logging(os_id): False [ 1363.151989] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.152495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.153215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.153215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.153215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.153451] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.153511] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.153574] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.153757] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.153898] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.154021] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be updated. [ 1363.210250] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.210494] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.210571] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.210781] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.210934] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.224059] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 2s [ 1365.239703] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1365.240174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.555704] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.556159] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1371.557063] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.557410] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1373.374204] env[69499]: INFO networking_nsxv3.common.synchronization [req-33fee238-a220-4f05-a4e6-7384a08eeee7 req-76da6a00-b5ee-4989-8529-e395e8d4608b tempest-ServerActionsTestOtherB-1591609705 tempest-ServerActionsTestOtherB-1591609705-project-member] Enqueued Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1373.374732] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717f63b4-82e8-4749-8d24-1abe7790389b with Priority: HIGHEST for action security_group_members [ 1373.375100] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-717f63b4-82e8-4749-8d24-1abe7790389b taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.375231] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.375286] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.375482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.375639] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.375735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.375803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.375940] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.376038] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.376132] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('717f63b4-82e8-4749-8d24-1abe7790389b',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.878437] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.878655] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.878655] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.878881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.878989] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.879209] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.879322] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.879387] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.879539] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.879610] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.879697] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b is going to be updated. [ 1373.910017] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.910180] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.910244] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.910444] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.910671] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.922213] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: IN_PROGRESS for 2s [ 1375.933084] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 717f63b4-82e8-4749-8d24-1abe7790389b in Status: SUCCESS [ 1375.933084] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 717f63b4-82e8-4749-8d24-1abe7790389b deletion is rescheduled due to dependency. [ 1375.933084] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-717f63b4-82e8-4749-8d24-1abe7790389b" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.199478] env[69499]: INFO networking_nsxv3.common.synchronization [req-38cdeb4b-967b-40e1-bb6b-a72dc4cf0614 req-f5b98c1c-08b0-43d1-9c88-c2b7f1db7c01 tempest-DeleteServersTestJSON-831065566 tempest-DeleteServersTestJSON-831065566-project-member] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1378.199806] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1378.201073] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.201073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.201073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.201073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.201073] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.201073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.201073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.201073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.201073] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.201073] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.706878] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.707132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.707132] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.707313] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.707405] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.707623] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.707728] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.707786] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.707941] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.708035] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.708122] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1378.744468] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.744640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.744640] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.744778] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.744908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.753729] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1380.763156] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1380.763477] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 deletion is rescheduled due to dependency. [ 1380.763477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.200465] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.200768] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1385.399780] env[69499]: INFO networking_nsxv3.common.synchronization [req-d668c59b-c4ba-40ad-90a2-fd55fd4f0a97 req-67b70e7f-5918-4a29-ae8f-6dac0158c08d tempest-DeleteServersTestJSON-831065566 tempest-DeleteServersTestJSON-831065566-project-member] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1385.400346] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1385.400666] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.400804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.400879] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.401101] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.401262] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.401367] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.401432] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.401596] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.401689] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.401783] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.647035] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.647249] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.647379] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.647669] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.647927] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.648100] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.648232] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.648457] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.648606] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.648817] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1385.648933] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1385.649058] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1385.649171] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1385.649286] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1385.649392] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1385.649524] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1385.671035] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1385.671160] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1385.671282] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1385.671479] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.671799] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-f42e906c-2b3e-40cf-b187-3010e98b43c1 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.671970] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-f42e906c-2b3e-40cf-b187-3010e98b43c1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.672105] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-f42e906c-2b3e-40cf-b187-3010e98b43c1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.672402] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-f42e906c-2b3e-40cf-b187-3010e98b43c1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.672542] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f42e906c-2b3e-40cf-b187-3010e98b43c1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.904049] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.904271] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.904320] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.904560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.904656] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.904852] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.904954] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.905028] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.905191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.905278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.905407] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1385.930339] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.930489] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.930533] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.930663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.930791] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.940473] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1386.174552] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.174817] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.174902] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.175289] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.175473] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.175635] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port f42e906c-2b3e-40cf-b187-3010e98b43c1 not found, creating... [ 1386.175933] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.176132] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.176259] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.176527] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.176675] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.176964] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.177141] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.177261] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.177471] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.177608] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.177747] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: f42e906c-2b3e-40cf-b187-3010e98b43c1 is going to be created. [ 1386.223509] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.223713] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.223843] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.224169] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.224406] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.224625] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-f42e906c-2b3e-40cf-b187-3010e98b43c1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.863200] env[69499]: INFO networking_nsxv3.common.synchronization [req-d668c59b-c4ba-40ad-90a2-fd55fd4f0a97 req-c61d4f36-b533-43ff-b04d-0cfc87fd32ed service nova] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_rules [ 1386.863200] env[69499]: INFO networking_nsxv3.common.synchronization [req-d668c59b-c4ba-40ad-90a2-fd55fd4f0a97 req-c61d4f36-b533-43ff-b04d-0cfc87fd32ed service nova] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1386.863493] env[69499]: INFO networking_nsxv3.common.synchronization [req-d668c59b-c4ba-40ad-90a2-fd55fd4f0a97 req-c61d4f36-b533-43ff-b04d-0cfc87fd32ed service nova] Enqueued Resource ID: f42e906c-2b3e-40cf-b187-3010e98b43c1 with Priority: HIGHEST for action port [ 1386.863552] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_rules [ 1386.863681] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1386.863778] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f42e906c-2b3e-40cf-b187-3010e98b43c1 with Priority: HIGHEST for action port [ 1386.864348] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.864479] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.864548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.864777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.864821] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.866101] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.866203] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.866396] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-f42e906c-2b3e-40cf-b187-3010e98b43c1 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.866495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f42e906c-2b3e-40cf-b187-3010e98b43c1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.866669] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f42e906c-2b3e-40cf-b187-3010e98b43c1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.866857] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f42e906c-2b3e-40cf-b187-3010e98b43c1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.866902] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f42e906c-2b3e-40cf-b187-3010e98b43c1',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.366827] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.366994] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.370188] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f42e906c-2b3e-40cf-b187-3010e98b43c1 with status ACTIVE [ 1387.370188] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.370188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.370188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.370188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.370188] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.370188] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.370493] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.370493] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.370493] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.370634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.372153] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.372153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.372153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.372153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.372153] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.372153] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f42e906c-2b3e-40cf-b187-3010e98b43c1 is going to be updated. [ 1387.394912] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.395060] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.395150] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.395334] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.395465] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.395611] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f42e906c-2b3e-40cf-b187-3010e98b43c1" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.950460] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1387.950777] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 deletion is rescheduled due to dependency. [ 1387.950777] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.950892] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.951158] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.951346] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.951466] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.951526] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.951676] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.951757] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.951852] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.454382] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.956748] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.459560] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.459920] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.459920] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.460175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.460175] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.460339] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1389.491938] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.492236] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.492317] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.492486] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.492632] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.500943] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1391.512423] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1391.512762] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.512821] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.513009] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.513204] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.513323] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.513392] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.513549] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.513633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.513720] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.513808] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.864956] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.865130] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1392.016124] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.016326] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.016326] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.016532] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.016714] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.016802] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.016870] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.017043] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.017136] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.017225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.017369] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.017461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.017515] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.017658] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.017791] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.017881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.017938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.018084] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.018160] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.018243] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.018330] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.520825] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7217eab0-c018-4859-a8da-01f90f62c7f0: rpc.has_security_group_logging(os_id): False [ 1392.539991] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.540219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.540219] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.540400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.540491] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.540701] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.540801] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.540858] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.541018] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.541101] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.541290] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.541394] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.541446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.541579] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.541654] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.541828] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.541923] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.541982] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.542135] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.542211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.542295] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1392.632334] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.632552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.632552] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.632742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.632883] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.648952] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1394.667361] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1394.667361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.865935] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.866233] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.209024] env[69499]: INFO networking_nsxv3.common.synchronization [req-654df9be-61a5-4f99-9d5d-719cd9820e47 req-a83c86b0-0552-4c1f-8992-efbf06902362 tempest-DeleteServersTestJSON-831065566 tempest-DeleteServersTestJSON-831065566-project-member] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1398.209581] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1398.209910] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.210021] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.210116] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.210272] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.210424] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.210547] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.210630] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.210834] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.210922] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.211058] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.712782] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.712952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.712952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.713215] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.713310] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.713514] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.713616] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.713676] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.713826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.713907] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.714016] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1398.856962] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.857151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.857199] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.857400] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.857533] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.865805] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1400.876290] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1400.876633] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 deletion is rescheduled due to dependency. [ 1400.876633] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.210883] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.211272] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.876822] env[69499]: INFO networking_nsxv3.common.synchronization [req-de17b471-7cf6-4297-a176-624398e7ec4e req-35f73f97-aee9-44a4-81e3-7b9c766d8e88 tempest-DeleteServersTestJSON-831065566 tempest-DeleteServersTestJSON-831065566-project-member] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1406.877374] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1406.877684] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.877803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.877872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.878240] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.878390] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.878499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.878563] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.878727] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.878811] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.878935] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.125792] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.125999] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.126141] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.126412] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.126992] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.127180] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.127304] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.127526] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.127677] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.127891] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1407.128015] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1407.128180] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1407.128299] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1407.128417] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1407.128526] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1407.128664] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1407.147963] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1407.148141] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1407.148285] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1407.148460] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.148743] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-cdf1e85a-491a-46e7-9eb8-a1235a36781d taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.148911] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-cdf1e85a-491a-46e7-9eb8-a1235a36781d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.149049] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-cdf1e85a-491a-46e7-9eb8-a1235a36781d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.149339] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-cdf1e85a-491a-46e7-9eb8-a1235a36781d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.149497] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdf1e85a-491a-46e7-9eb8-a1235a36781d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.380830] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.381054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.381054] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.381247] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.381347] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.381554] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.381658] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.381724] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.381888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.381969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.382072] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1407.409361] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.409556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.409556] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.409747] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.409889] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.418150] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1407.652180] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.652399] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.652534] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.652877] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.653051] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.653224] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port cdf1e85a-491a-46e7-9eb8-a1235a36781d not found, creating... [ 1407.653487] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.653664] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.653786] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.654430] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.654430] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.654568] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.654672] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.654743] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.654995] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.655156] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.655304] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: cdf1e85a-491a-46e7-9eb8-a1235a36781d is going to be created. [ 1407.675881] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.676069] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.676203] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.676449] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.676675] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.676891] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-cdf1e85a-491a-46e7-9eb8-a1235a36781d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.345485] env[69499]: INFO networking_nsxv3.common.synchronization [req-de17b471-7cf6-4297-a176-624398e7ec4e req-c66a1465-6a5e-404e-ac1c-c39ab98ac981 service nova] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_rules [ 1408.345820] env[69499]: INFO networking_nsxv3.common.synchronization [req-de17b471-7cf6-4297-a176-624398e7ec4e req-c66a1465-6a5e-404e-ac1c-c39ab98ac981 service nova] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1408.345967] env[69499]: INFO networking_nsxv3.common.synchronization [req-de17b471-7cf6-4297-a176-624398e7ec4e req-c66a1465-6a5e-404e-ac1c-c39ab98ac981 service nova] Enqueued Resource ID: cdf1e85a-491a-46e7-9eb8-a1235a36781d with Priority: HIGHEST for action port [ 1408.346151] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_rules [ 1408.346285] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1408.346407] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf1e85a-491a-46e7-9eb8-a1235a36781d with Priority: HIGHEST for action port [ 1408.346951] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.347094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.347165] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.347361] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.347442] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.348275] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.348364] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.348952] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdf1e85a-491a-46e7-9eb8-a1235a36781d taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.348952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdf1e85a-491a-46e7-9eb8-a1235a36781d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.348952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdf1e85a-491a-46e7-9eb8-a1235a36781d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.348952] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdf1e85a-491a-46e7-9eb8-a1235a36781d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.348952] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdf1e85a-491a-46e7-9eb8-a1235a36781d',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.852474] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.852609] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.854946] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdf1e85a-491a-46e7-9eb8-a1235a36781d with status ACTIVE [ 1408.855140] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.855254] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.855315] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.855524] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.855614] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.855779] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.855872] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.855932] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.856094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.856169] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.856347] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.856440] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.856499] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.856651] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.856732] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.856817] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdf1e85a-491a-46e7-9eb8-a1235a36781d is going to be updated. [ 1408.880920] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.881080] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.881128] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.881281] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.881409] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.881558] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdf1e85a-491a-46e7-9eb8-a1235a36781d" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.428037] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1409.428332] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 deletion is rescheduled due to dependency. [ 1409.428332] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.428478] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.428690] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.428866] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.428978] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.429049] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.429198] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.429277] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.429369] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.931121] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.434836] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.937586] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.937782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.937850] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.938055] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.938166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.938253] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1410.966253] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.966388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.966388] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.966782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.966782] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.974714] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1412.986177] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1412.986454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.986545] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.986763] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.986947] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.987075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.987141] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.987291] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.987373] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.987461] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.987550] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.347550] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.347744] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1413.489526] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.489742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.489742] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.490020] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.490232] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.490360] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.490448] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.490634] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.490745] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.490876] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.491075] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.491202] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.491283] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.491453] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.491620] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.491735] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.491813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.491977] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.492089] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.492207] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.492305] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.994695] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7217eab0-c018-4859-a8da-01f90f62c7f0: rpc.has_security_group_logging(os_id): False [ 1414.013714] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.013893] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.013949] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.014129] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.014223] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.014461] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.014563] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.014628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.014783] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.014862] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.015057] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.015151] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.015213] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.015351] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.015424] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.015619] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.015712] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.015772] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.015908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.015980] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.016078] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1414.134586] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.134803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.134803] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.134966] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.135138] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.154344] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1416.172826] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1416.173278] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.348516] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.348878] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1419.651629] env[69499]: INFO networking_nsxv3.common.synchronization [req-38f3c055-9def-4cfe-9d23-cad0028e9a4e req-e00c00ad-a44e-4bf7-b4bc-7192e9e722c2 tempest-DeleteServersTestJSON-831065566 tempest-DeleteServersTestJSON-831065566-project-member] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1419.652087] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1419.652386] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.652512] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.652581] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.652773] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.652924] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.653181] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.653312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.653512] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.653670] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.653742] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.155933] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.156112] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.156225] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.156413] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.156516] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.156727] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.156836] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.156888] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.157085] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.157226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.157226] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1420.195144] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.195309] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.195354] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.195575] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.195739] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.207057] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1422.218096] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1422.218454] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 deletion is rescheduled due to dependency. [ 1422.218454] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.653051] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1424.653051] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.086051] env[69499]: INFO networking_nsxv3.common.synchronization [req-7358571e-7d34-495a-ba54-2e4445282f00 req-27e0df7c-3719-4233-a7e7-f66ab61984a5 tempest-DeleteServersTestJSON-831065566 tempest-DeleteServersTestJSON-831065566-project-member] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1428.086484] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1428.086816] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.086941] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.087027] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.087216] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.087362] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.087458] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.087521] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.088012] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.088105] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.088202] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.340391] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.340596] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.340727] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.341021] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.341294] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.341457] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.341578] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.341816] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.341949] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.342177] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1428.342294] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] NeedRegenerationException {{(pid=69499) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1428.342418] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] no value, waiting for create lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1428.342562] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] value creation lock acquired {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1428.342727] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] No value present for key: 'zone-id' {{(pid=69499) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1428.342843] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Calling creation function for not-yet-present value {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1428.343024] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1428.363109] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1428.363328] env[69499]: DEBUG dogpile.cache.region [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69499) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1428.363539] env[69499]: DEBUG dogpile.lock [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Released creation lock {{(pid=69499) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1428.363776] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "network-600" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.364140] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock port-d443ac3b-2086-4c54-a6cf-50cb882b7bb8 taken with stack trace [, , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.364363] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "port-d443ac3b-2086-4c54-a6cf-50cb882b7bb8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.364558] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "port-d443ac3b-2086-4c54-a6cf-50cb882b7bb8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.364948] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "port-d443ac3b-2086-4c54-a6cf-50cb882b7bb8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.365255] env[69499]: DEBUG networking_nsxv3.api.rpc [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d443ac3b-2086-4c54-a6cf-50cb882b7bb8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.590403] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.590629] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.590629] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.590826] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.590908] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.591095] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.591251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.591251] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.591401] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.591482] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.591548] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1428.616021] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.616226] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.616294] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.616450] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.616585] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.624998] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1428.868355] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.868355] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.868355] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.868619] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.868656] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.868801] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Segment Port d443ac3b-2086-4c54-a6cf-50cb882b7bb8 not found, creating... [ 1428.869291] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.869291] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.869463] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.869712] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.869860] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.870164] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.870328] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.870449] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.870663] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.870804] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.870948] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Resource: SegmentPort with ID: d443ac3b-2086-4c54-a6cf-50cb882b7bb8 is going to be created. [ 1428.893593] env[69499]: DEBUG networking_nsxv3.common.locking [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.893802] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.893910] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.894177] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.894401] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.894649] env[69499]: DEBUG oslo_concurrency.lockutils [None req-2c6950cc-e0cd-44dd-94c7-4191897eae0b None None] Releasing lock "port-d443ac3b-2086-4c54-a6cf-50cb882b7bb8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.556353] env[69499]: INFO networking_nsxv3.common.synchronization [req-7358571e-7d34-495a-ba54-2e4445282f00 req-6c371a10-9e60-4316-960e-726b2d8592ca service nova] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_rules [ 1429.556603] env[69499]: INFO networking_nsxv3.common.synchronization [req-7358571e-7d34-495a-ba54-2e4445282f00 req-6c371a10-9e60-4316-960e-726b2d8592ca service nova] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1429.556685] env[69499]: INFO networking_nsxv3.common.synchronization [req-7358571e-7d34-495a-ba54-2e4445282f00 req-6c371a10-9e60-4316-960e-726b2d8592ca service nova] Enqueued Resource ID: d443ac3b-2086-4c54-a6cf-50cb882b7bb8 with Priority: HIGHEST for action port [ 1429.556955] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_rules [ 1429.557180] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1429.557302] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d443ac3b-2086-4c54-a6cf-50cb882b7bb8 with Priority: HIGHEST for action port [ 1429.557881] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.558015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.558087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.558285] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.558365] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.559195] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.559312] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.559481] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock port-d443ac3b-2086-4c54-a6cf-50cb882b7bb8 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.559569] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d443ac3b-2086-4c54-a6cf-50cb882b7bb8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.559649] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d443ac3b-2086-4c54-a6cf-50cb882b7bb8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.559797] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d443ac3b-2086-4c54-a6cf-50cb882b7bb8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.559864] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d443ac3b-2086-4c54-a6cf-50cb882b7bb8',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.061726] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.061726] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.064232] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d443ac3b-2086-4c54-a6cf-50cb882b7bb8 with status ACTIVE [ 1430.064343] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.064431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.064431] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.064755] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.064875] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.065096] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.065266] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.065343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.065509] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.065593] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.065780] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.065880] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.065938] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.066087] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.066166] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.066242] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d443ac3b-2086-4c54-a6cf-50cb882b7bb8 is going to be updated. [ 1430.090462] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.090628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.090628] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.090804] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.090929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.091088] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d443ac3b-2086-4c54-a6cf-50cb882b7bb8" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.634247] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1430.634588] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 deletion is rescheduled due to dependency. [ 1430.634588] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.634718] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.634911] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.635105] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.635224] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.635292] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.635449] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.635548] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.635648] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.138164] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.641043] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.143032] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.143194] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.143252] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.143468] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.143560] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.143655] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1432.172990] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.173159] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.173210] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.173382] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.173519] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.181711] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1434.195447] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1434.195741] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.195847] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.196065] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.196254] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.196368] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.196434] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.196587] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.196663] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.196748] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.196840] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.557917] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1434.558193] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1434.699081] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.699343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.699343] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.699495] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.699649] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.699761] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.699830] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.699969] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.700070] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.700212] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.700284] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.700381] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.700446] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.700578] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.700718] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.700808] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.700868] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.701015] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.701094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.701174] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.701263] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.203591] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7217eab0-c018-4859-a8da-01f90f62c7f0: rpc.has_security_group_logging(os_id): False [ 1435.220076] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.220249] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.220298] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.220477] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.220565] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.220780] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.220881] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.220948] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.221117] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.221191] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.221375] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.221469] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.221527] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.221659] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.221731] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.221906] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.222008] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.222075] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.222214] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.222287] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.222369] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1435.304666] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.304860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.304860] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.305488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.305488] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.321651] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1437.336030] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1437.336380] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.558970] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1439.559356] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1444.560165] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1444.560412] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1449.561247] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1449.561682] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1454.562388] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1454.562702] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1459.564208] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.564606] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1464.565643] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.565984] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1465.540305] env[69499]: INFO networking_nsxv3.common.synchronization [req-6ea00f1c-2776-4227-ad52-7e61b0fd30f7 req-df064f2b-971a-4cba-a639-c044e270de61 tempest-DeleteServersTestJSON-831065566 tempest-DeleteServersTestJSON-831065566-project-member] Enqueued Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1465.540864] env[69499]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 with Priority: HIGHEST for action security_group_members [ 1465.541358] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock member-7217eab0-c018-4859-a8da-01f90f62c7f0 taken with stack trace [, , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.541558] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.541631] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.541813] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.541996] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.542120] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.542211] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.542387] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.543024] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.543024] env[69499]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7217eab0-c018-4859-a8da-01f90f62c7f0',) {} {{(pid=69499) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.045404] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.045821] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.045821] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.047668] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.047818] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.048139] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.048306] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.048393] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.048576] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.048681] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.048788] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 is going to be updated. [ 1466.076786] env[69499]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69499) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.076929] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.076983] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.077171] env[69499]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.077330] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.084843] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: IN_PROGRESS for 2s [ 1468.095670] env[69499]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 in Status: SUCCESS [ 1468.096094] env[69499]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7217eab0-c018-4859-a8da-01f90f62c7f0 deletion is rescheduled due to dependency. [ 1468.096094] env[69499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7217eab0-c018-4859-a8da-01f90f62c7f0" {{(pid=69499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.542339] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.542722] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1475.543664] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1475.543664] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1480.545300] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1480.545300] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1485.546120] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1485.546582] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1490.547084] env[69499]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.547485] env[69499]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1492.852363] env[69499]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1492.852635] env[69499]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-104e53bb-b0dd-4632-aa3e-8e7fcd5809c1 None None] NSXv3 Agent Agent loop - iteration:4 started